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ABSTRACT : 

CHG DATE=19991102 STATUS=0> A color correction system that 
implements 

scene-by- scene color manipulation in the primary color domain to 
color 

correction regions of a video image isolated in the hue domain using 
hue, 

saturation, and luminance qualification. The system may be 
configured as a 
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number of color correction blocks arranged in series or parallel. 
Each 

correction block typically allows a colorist to define up to sixteen 
non- overlapping hue sectors with associated corrected color values 
and 

qualification curves. Each color correction block has two video 
inputs, a 

first connected to the output from the previous block, and a second 
connected 

to an unprocessed video signal. Each block includes a video 
multiplexer that 

operates as a switch allowing the colorist to select either the 
output of a 

previous block or the unprocessed video input signal as the input for 
a given 

block. Delay buffers are positioned in the unprocessed video signal 
between 

each color correction block to synchronize the unprocessed video 
signal with 

the output video signal from the preceding color correction block. 
Thus , the 

color correction blocks may be applied separately (i.e., in parallel) 
or in 

tandem (i.e., in series) for each scene processed. In addition, a 
particular 

colorist may select the number of blocks in the system in accordance 
with that 
colorist 1 s needs. 



7/12/2007, EAST Version: 2.1.0.14 



Illllllllllllllllllllllllllllllllllllllllllllllll 

(id EP 0 947 956 A2 

(12) EUROPEAN PATENT APPLICATION 

(43) Date of publication: (51) int. CI. 6 : G06T 5/40 

06.10.1999 Bulletin 1999/40 

(21) Application number: 99106637.4 



(22) Date of filing: 31 .03.1999 



(84) Designated Contracting States: 


• Barton, Nicholas 


AT BE CH CY DE DK ES R FR GB GR IE IT LI LU 


Coral Springs, FL 33071 (US) 


MCNLPTSE 


• Taylor, Troy 


Designated Extension States: 


Boynton, FL 33462 (US) 


ALLTLVMKROSI 


• Gu, Xueming Henry 




Weston, FL 33326 (US) 


(30) Priority: 03.04.1998 US 80620 P 






(74) Representative: 


(71) Applicant: 


Solf, Alexander, Dr. 


Da Vinci Systems, Inc. 


PatentanwSlte 


Fort Lauderdale, Florida 33309 (US) 


Dr. Solf & Zapf 


(72) Inventors: 


Candidplatz 15 


81543 Munchen (DE) 


• Rai, Sanjay Devappa 


Fort Lauderdale, FL 33309 (US) 





(54) Primary and secondary color manipulations using hue, saturation, luminance and area 
isolation 



(57) A color correction system that implements 
scene-by-scene color manipulation in this primary color 
domain to color correction regions of a video image iso- 
lated in the hue domain using hue, saturation, and lumi- 
nance qualification. The system may be configured as a 
number of color correction blocks arranged in series or 
parallel. Each correction block typically allows a colorist 
to define up to sixteen non-overlapping hue sectors with 
associated corrected color values and qualification 
curves. Each color correction block has two video 
inputs, a first connected to the output from the previous 
block, and a second connected to an unprocessed 
video signal. Each block includes a video multiplexer 
that operates as a switch allowing the colorist to select 
either the output of a previous block or the unprocessed 
video input signal as the input for a given block. Delay 
buffers are positioned in the unprocessed video signal 
between each color correction block to synchronize the 
unprocessed video signal with the output video signal 
from the preceding color correction block. Thus, the 
color correction blocks may be applied separately (i.e., 
in parallel) or in tandem (i.e., in series) for each scene 
processed. In addition, a particular colorist may select 
the number of blocks in the system in accordance with 
that colorist's needs. 



Europaisches Patentamt 
(19) f))]] European Patent Office 

Office europ6en des brevets 



Primed by Xerox (UK) Business Services 
2.16.7/36 



7/12/2007, EAST Version: 2.1.0.14 



1 



EP0 947 956 A2 



2 



Description 
TECHNICAL FIELD 

[0001] ' The present invention relates generally to 
image processing, and more particularly relates to a 
system and methods that allow the user of an image 
processing system to implement scene-by-scene color 
manipulation in the primary color domain to color cor- 
rection regions of a video image isolated in the hue 
domain using hue, saturation, and luminance qualifica- 
tion. 

BACKGROUND OF THE INVENTION 

[0002] In a video signal color correction system, vari- 
ous types of image processing are often employed to 
create, enhance, compress, filter, or otherwise modify 
characteristics of the video image. In certain types of 
video image processing systems, especially* post-pro- 
duction color correction systems for motion picture film 
and/or video tape, color corrections are typically made 
on a scene-by-scene basis. A "scene" is a sequential 
collection of image, often shot from the same camera, 
having the same viewpoint, composed in a certain way, 
etc. An operator using a typical post-production color 
correction system observes a target frame of the scene 
on a video monitor, adjusts the color and other parame- 
ters of the frame until it is aesthetically satisfactory, and 
stores the color correction parameters in system mem- 
ory. The color correction system preferably automates 
the application the stored color correction parameters to 
the other frames of the scene. 
[0003] For example, the system operator or "cotorisf 
typically selects a scene to manipulate, and then selects 
a particular frame from the scene for manual manipula- 
tion. The colorist views the target frame as a still image 
on the system monitor and applies color corrections via 
a control panel to adjust the color parameters for a par- 
ticular region of the target frame. The color correction 
system typically allows the colorist to isolate a particular 
region of the frame and to alter the intensity of the pri- 
mary color components, red, green and blue, which in 
various combinations produce all of the colors that the 
system can produce. The colorist may than apply color 
corrections to another region of the frame, and so forth, 
until all of the desired regions have been color cor- 
rected. The correction settings are then stored in sys- 
tem memory. 

[0004] After the colorist is satisfied with the adjust- 
ments made to the target frame, the color correction 
system, which is typically computer<ontrolled, auto- 
matically applies the stored color corrections to each 
frame in the scene on a frame-by-frame basis. The color 
corrected frames of the scene are then recorded on film 
or videotape. The steps are repeated for other scenes in 
the film or video tape, often with different correction set- 
tings stored for different scenes. This process may be 



repeated as needed to create a color corrected master 
film or video tape that reflects multiple color adjust- 
ments to multiple frames in multiple scenes. In the gen- 
eral case, multiple color adjustments may be applied to 
5 all of the frames of a motion picture or other video pro- 
gram. 

[0005] Devices are known in the art for isolating a 
region of a still image for applying one set of color cor- 
rections, with other regions of the image receiving a dif- 

10 ferent set of color corrections. These devices allow a 
color correction system to isolate a particular region of 
a frame to receive special image processing. For exam- 
ple, when color correcting a soft drink commercial it may 
be desirable to isolate the beverage container from the 

is remainder of the image. The color of the beverage con- 
tainer may then be enhanced to make the can stand out 
from the rest of the image. But applying color correction 
to each frame of a film or video tape individually is 
extremely tedious and time consuming. Automating the 

20 process of applying the color correction parameters 
defined for one frame of a scene to the other frames is, 
therefore, highly desirable. 

[0006] Automatically isolating a color correction region 
presents a difficult technical problem because the 

25 region of interest may change in size, shape, location, 
and/or geometry over the frames ir> a scene. That is, an 
object in a video scene typically moves over the frames 
of the scene. For example, oonsider a scene in which a 
bottle is lifted, tilted, moved toward a glass, turned 

30 toward the viewer, and then further tilted to pour the 
contents of the bottle into a glass. In this scene, the L 
geometry of the bottle changes from a side view of the 
bottle (an irregular shape) to a top view of the bottle (an 
essentially round shape). The bottle also changes in 

35 location and size over the several frames of the scene. 
[0007] The state of the art in automated color correc- 
tion technology is somewhat lacking for a number of 
reasons. Video images are typically defined on a pixel- 
by-pixel basis by intensity levels of the primary colors, 

40 red, green and blue (R.G.B). In a typical color correction 
system, the primary colors are mixed in varying intensi- 
ties to produce all of the colors that the system can pro- 
duce. Color data in the R.G.B format, often referred to 
as the "primary color domain," may be linearly trans- 

45 formed into secondary color components, hue, satura- 
tion and luminance, which is sometimes referred to as 
the "hue domain." Certain prior art color correction sys- 
tems apply color corrections in the primary color 
domain, whereas others apply color corrections in hue 

so domain. 

[0008] Operating in the primary color domain has cer- 
tain drawbacks associated with isolating color correc- 
tion regions. In a color video image, the intensity of the 
red, green, and blue components for a particular object 
55 depicted in a scene can vary from frame to frame in 
response to the brightness, or shadowing, of the item. In 
addition, many different colors may have the same 
intensity of one of the particular color components. For 



2 



7/12/2007, EAST Version: 2.1.0.14 



3 EP0 947 

this reason, it is difficult to isolate a particular object in a 
scene by focusing on the intensity of the red, green, and 
blue constituents of the pixels of the object. In other 
words, isolating a particular object, as that object moves 
from frame to frame within a scene, is difficult when 5 
analyzing the video data in the primary color domain. 
[0009] Color correction systems that operate in the 
hue domain have been developed to overcome the 
region isolation drawbacks associated with color correc- 
tion system that operate in the primary color domain. 10 
For example, color correction systems have been devel- 
oped that allow an operator to select and manipulate a 
color correction region in the hue domain. These sys- 
tems typically include equipment for generating and 
positioning a cursor on a video monitor to allow selec- 15 
tion of a color correction region defined by the hue at the 
selected position. Circuitry responsive to the cursor 
location selects one of a plurality of color correction cir- 
cuits to become operative for directing secondary color 
correction parameters (i.e.. adjustments to the hue, sat- 20 
uration, and luminance) only to regions in the video 
image corresponding to the hue selected by the cursor. 
This type of system therefore allows application of sec- 
ondary color correction parameters to all regions of the 
image bearing the hue that was selected with the cur- 25 
sor. 

[0010] Color correction systems that operate in the 
hue domain, however, also exhibit certain drawbacks. 
First, they incur a relatively high processing overhead 
because the entire video image is typically transformed 30 
from the primary color domain to the hue domain. Color 
corrections are then applied in the hue domain, and the 
image is then transformed back from the hue domain to 
the primary color domain. Thus, the system performs 
two linear transformations on the entire video image 35 
even though no color corrections may be applied to 
large portions of the image. As a result, even those por- 
tions of the video image that are not color corrected 
must be transformed from the primary color domain to 
the hue domain, and then back to the primary color 40 
domain. 

[001 1 ] Second, transforming color data from the pri- 
mary color domain to the hue domain, and then back to 
the primary color domain, can impart "color artifacts" 
into the video image. That is, applying a linear mathe- 45 
matical operation to digital data, followed by the inverse 
mathematical operation, can alter the data for a small 
percentage of pixels. This phenomenon occurs due to 
the truncation of irrational number in floating-point arith- 
metic. Stated differently, due to the limited precision of so 
linear mathematical operations applied to digital data, 
applying an arithmetic operation to digital data, followed 
by the inverse arithmetic operation, can alter the values 
for some of the data points. Although the vast majority of 
data points are not altered by the arithmetic operations, ss 
a small percentage of data points are typically altered. 
These altered data points are known as "color artifacts." 
[001 2] To avoid the combined drawbacks associated 
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with region isolation in the primary color domain and 
color artifacts created through operation in the hue 
domain, color correction systems have developed that 
apply color corrections in the primary color domain 
using geometric constraints to isolate color correction 
regions. For example, certain color correction systems 
include a video parameter control system operative for 
selecting a spatial region or window in a video image for 
color correction. A track ball allows selection of a spatial 
region by dragging a cursor to draw a window around an 
object of interest in the picture. The operator then 
adjusts controls that affect only the selected window or 
region. A first set of correction signals may be stored for 
the selected region, and a separate second set of cor- 
rection signals may be stored for areas of the picture 
outside the selected region, thereby allowing multiple 
sets of corrections for a given frame. Although these 
systems provide some control over the movement of the 
window over a plurality of frames in a scene, the region 
is essentially static and the geometry is invariably that of 
a box. 

[0013] Other prior art image processing computer 
software known as the "Simple Windows" and "Power 
Windows" features are extensions of the windows fea- 
tures of previous system. These features are provided 
in the RENAISSANCE 8:8:8™ digital color enhance- 
ment system, manufactured by the assignee of the 
present invention. In the Simple Windows feature, a win- 
dow is a predetermined regularly shaped area or region 
of the video image that can be varied in size. The colors 
within the window are independently adjustable from 
the colors of the rest of the image. Primary or secondary 
color enhancements can occur both inside and outside 
a window, and each adjustment is independent of the 
other. The Simple Windows feature entails use of a sim- 
ple geometric form— a square or rectangle— for a win- 
dow shape. A Simple window is always rectangular and 
is defined by four points. Lines defining the window are 
always straight vertical or horizontal. Furthermore, there 
are no soft edges, that is, there is a sharp delineation 
between the inside and outside of the window, which 
sometimes produces undesirable image effects at the 
boundaries. 

[001 4] The more recent "Power Windows" feature pro- 
vides more choices of the shape for the window, for 
example, circular, rectangular, half screen, split in the 
middle, etc. Using this system, the operator can select 
windows including multiple squares, multiple diamonds 
(essentially rotated squares), horizontal and vertical 
bars, circles, ellipses (a warped circle), and so forth. 
The sizes of these windows can be varied so long as the 
shape remains regular. Furthermore, a "soft edges" fea- 
ture is available to provide a gradual transition in color 
correction from the inside to the outside of a selected 
window. Power Windows, however, are still confined to 
regular shapes, with predefined geometry. 
[001 5] The commonly owned patent application Serial 
No. 08/912,662, entitled "User Defined Windows For 
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Selecting Image Processing Regions," filed August 18, 
1997 by Xueming Henry Gu. et al., describes further 
improvements in the RENAISSANCE 8:8:8™ digital 
color enhancement system. This system allows the user 
to select color correction regions corresponding to 
objects in a target frame using a geometric masking 
technique. For example, the user may mask the same 
object in the first and last frames of a scene. The system 
then automatically "morphs" or changes the shape of a 
selected object over the intervening frames of a scene. 
Although the system can automatically morph an object 
over a number of frames, the edges of the automati- 
cally-morphed object can diverge from the edges of the 
actual object in the scene. The system therefore 
includes a utility that allows the user to manually correct 
automatically-morphed objects on a frame-by-frame 
basis. While this utility is quite effective for correcting 
unacceptable divergence, manually imparting the 
required adjustments on a frame-by-frame basis can be 
tedious and time consuming. 
[0016] In sum, there is a continuing need for a color 
correction system that allows the isolation of color cor- 
rection regions that move and change size and geome- 
try over several frames in a scene. There is a further 
need for a color correction system that isolates regions 
and implements color corrections without imparting 
color artifacts into the video image. And there is a need 
for further for automating the process of color correction 
region isolation to minimize or obviate the need for man- 
ual frame-by-frame adjustment of the processed video 
image. 

SUMMARY OF THE INVENTION 

[0017] The present invention overcomes the disad- 
vantages described above in a color correction system 
that implements primary color manipulation using sec- 
ondary color correction region isolation. As such, the 
system performs color correction in the primary color 
domain, which means that color data that is not manip- 
ulated passes through the system unaltered. This 
aspect of the invention prevents color artifacts from 
appearing in the processed video image and lowers the 
data processing overhead because no operations, other 
than timed buffering to maintain synchronism, are per- 
formed for unprocessed or pass-through pixels. 
[0018] Although color correction is performed in the 
primary color domain, the system isolates color correc- 
tion regions through operations performed in the hue 
domain. Specifically, hue qualification, saturation quali- 
fication, luminance qualification, and an optional alpha 
filter are combined to define an alpha qualification func- 
tion that isolates a region or "hue sector" for color cor- 
rection. The alpha qualification function may have a 
shape in the hue domain that tapers or softens the 
applied color correction towards the edges of the cor- 
rected hue sector. The system includes a user interface 
that allows the colorist to select the shape of the hue, 



saturation, and luminance alpha qualification functions, 
as well as the shape of the optional alpha filter, in the 
hue domain. This aspect of the invention gives the 
colorist fine control over the color isolation and correc- 
5 tion process, including fine control over the sharpness 
of the color correction at the edges of color corrected 
hue sectors. 

[0019] Color correction region isolation in the hue 
domain may be combined with geometric constrains. 

10 Geometric constraints allow the colorist to limit the auto- 
matic application of color correction to a defined portion 
of the frame area, over the several frames of a scene. 
As a mechanism for selectively applying color correction 
to the frames of a scene, geometric constraints may be 

is used to increases the system's ability to isolate discrete 
objects for color correction. For example, a colorist may 
use a geometric constraint to exclude from color correc- 
tion discrete objects that have a similar color to a target 
object. 

20 [0020] Generally described, the invention is a compu- 
ter-implemented process for selectively applying image 
processing to an image. Color correction equipment 
receives an input signal from an image source in a pri- 
mary color domain. The color correction equipment also 

25 receives a command selecting a sample of the input sig- 
nal, and a command identifying a color correction 
parameter in the primary color domain associated with 
the sample. The color correction equipment determines 
a hue-domain parameter associated with the sample 

30 and a sector in the hue-domain about the hue-domain 
parameter associated with the sample. The color cor- 
rection equipment then defines a qualification curve cor- 
responding to the sector and mixes the input signal and 
the color correction parameter within the sector in 

35 accordance with the qualification curve. The hue- 
domain parameter may be selected from the group 
including hue, saturation, and luminance. 
[0021 ] The color correction equipment may also deter- 
mine a second hue-domain parameter associated with 

40 the sample and define a second qualification curve 
about the second hue-domain parameter and corre- 
sponding to the sector. The first and second qualifica- 
tion curves are then combined to obtain a combined 
qualification curve. In this case, the color correction 

45 mixes the input signal and the color correction parame- 
ter within the sector in accordance with the combined 
qualification curve. The first and second hue-domain 
parameters may be selected from the group including 
hue, saturation, and luminance. 

so [0022] In addition, the color correction equipment may 
determine a third hue-domain parameter associated 
with the sample and define a third qualification curve 
about the third hue-domain parameter and correspond- 
ing to the sector. The first, second, and third qualrf ica- 

55 tion curves are then combined to obtain a total 
qualification curve. In this case, the color correction 
equipment mixes the input signal and the color correc- 
tion parameter within the sector in accordance with the 
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total qualification curve. The first, second, and third hue- 
domain parameters may include the hue, saturation, 
and luminance. 

[0023] The color correction equipment may also apply 
a filter to the total qualification curve to obtain an alpha s 
qualification curve. If this case, the color correction 
equipment mixes the input signal and the color correc- 
tion parameter within the sector in accordance with the 
alpha qualification curve. Moreover, the color correction 
equipment may receive a command defining geometric 10 
constraint corresponding to the input signal. In this 
case, the color correction equipment limits the mixing 
the input signal and the color correction parameter in 
accordance with the geometric constraint. 
[0024] The invention also provides a computer-imple- is 
mented process for selectively applying image process- 
ing to a plurality of frames defining a scene. Color 
correction equipment receives an input signal defining 
the scene from the image source in a primary color 
domain. The color correction equipment also receives a 20 
command selecting a target frame of the scene and 
another command selecting a sample of the target 
frame. The color correction equipment also receives a 
command identifying a color correction parameter in the 
primary color domain associated with the sample. The 25 
color correction equipment then determines a hue- 
domain parameter associated with the sample and 
defines a sector in the hue-domain about the hue- 
domain parameter associated with the sample. The 
color correction equipment also defines a qualification 30 
curve corresponding to the sector. Then, for each frame 
of the scene, the color correction equipment mixes the 
input signal and the color correction parameter within 
the sector in accordance with the qualification curve. 
[0025] These and other features and advantages of 35 
the invention may be more clearly understood and 
appreciated from a review of the following detailed 
description of the disclosed embodiment, and by refer- 
ence to the appended drawings and claims. 

40 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0026] 

FIG. 1 is a schematic block diagram of a color cor- 45 
rection system constructed in accordance with an 
illustrative embodiment of the present invention. 
FIG. 2 is a schematic block diagram illustrating the 
use of an image processing system for implement- 
ing color correction isolation using secondary color so 
parameters. 

FIG. 3 (prior art) is a diagram illustrating the rela- 
tionship between the additive primary colors, a 
color wheel, and a color bar. 
FIG. 4 (prior art) is a diagram illustrating the rela- ss 
tionship between color parameters in the primary 
color domain and in the hue domain. 
FIG. 5 is a diagram illustrating a user interface for a 



color correction system. 

FIG. 6A is a diagram illustrating a portion of the 

user interface of FIG. 5 in greater detail. 

FIG. 6B is a diagram illustrating an alternative user 

interface for a color correction system. 

FIG. 7 is a logic flow diagram illustrating a method 

for operating a color correction system. 

FIG. 8 is a logic flow diagram illustrating a routine 

for automatically applying color corrections defined 

for a target frame of a scene to the other frames of 

the scene. 

FIG. 9 is a logic flow diagram illustrating a routine 
for computing a color correction qualifier for color 
enhancing a video scene. 
FIG. 10 is a schematic block diagram illustrating 
color correction equipment constructed in accord- 
ance with an illustrative embodiment of the present 
invention. 

FIG. 1 1 is a schematic block diagram illustrating 
color enhancement equipment that may form a 
component of the color correction equipment of in 
FIG 10. 

FIG. 12 is a schematic block diagram illustrating a 
color correction block that may form a component of 
the color enhancement equipment of in FIG 1 1 . 
FIG. 13A is a schematic block diagram illustrating a 
color mixer circuit that may form a component of the 
color correction block shown in FIG 12. 
FIG. 13B is a schematic block diagram illustrating a 
transformation matrix circuit that may form a com- 
ponent of the color correction block shown in FIG 
12. 

FIG. 14 is a schematic block diagram illustrating an 
index generator circuit that may form a component 
of the color correction block shown in FIG 12. 

DETAILED DESCRIPTION OF THE DISCLOSED 
EMBODIMENT 

[0027] The invention may be embodied a color correc- 
tion system that implements scene-by-scene color 
manipulation in the primary color domain to color cor- 
rection regions of a video image isolated in the hue 
domain using hue, saturation, and luminance qualifica- 
tion. The invention may be implemented using program- 
mable logic units (PLUs), field-programmable gate 
arrays (FPGAs), or other types of reprogrammable par- 
allel-processing hardware. The system may be config- 
ured as a number of color correction blocks arranged in 
series or parallel. Each correction block typically allows 
a colorist to define up to sixteen non-overlapping hue 
sectors with associated corrected color values and 
qualification curves. 

[0028] The color correction equipment processes a 
real-time video signal propagating at 74 mHz even 
though the color processing circuitry operates at 66 
mHz, This is possible because only a subset of the 
video signal needs to be passed through the color 
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processing circuitry. In particular, each frame of video 
data includes a visible raster defining the image shown 
on a display device, and a non-visible portion including 
horizontal and vertical overscan areas, retrace intervals, 
and so forth. Only the visible raster portion of the video 5 
signal needs to be passed through the color processing 
circuitry. The color correction equipment therefore strips 
the visible raster out of each frame and passes only the 
pixels of the visible raster through the 66 mHz color 
processing circuitry. 10 
[0029] The non-visible portion of each frame 
bypasses the color processing circuitry in an unproc- 
essed input video data signal propagating at 74 mHz. 
After the color corrected visible raster exits the color 
processing circuitry, the non-visible portion of each is 
frame is recombined with the color corrected visible 
raster to construct a complete output frame of video 
data. Of course, the timing must be controlled so that 
the color-corrected visible raster reaches the combining 
circuitry at the same time as the unprocessed input 20 
video signal. Because the ratio of the data in the visible 
raster to the data in a complete frame is equal to or less 
than the ratio of the data propagation rates (i.e. 66 
mHz:74 mHz - about 89%), the color correction equip- 
ment can perform the required timing operation, which 25 
allows the equipment to process an input video signal 
propagating a 74 mHz in real time. 
[0030] Each color correction block has two video 
inputs, a first input connected to the output from the pre- 
vious block, and a second input connected to an 30 
unprocessed video signal. Each block includes a video 
multiplexer that operates as a switch allowing the color- 
ist to select either the output of a previous block or the 
unprocessed video input signal as the input for a given 
block. Delay buffers are positioned in the unprocessed 35 
video signal between each color correction block to syn- 
chronize the unprocessed video signal with the output 
video signal from the preceding color correction block. 
Thus, the color correction blocks may be applied sepa- 
rately (i.e., in parallel) or in tandem (i.e., in series) for 40 
each scene processed. In addition, a particular colorist 
may select the number of blocks in the system in 
accordance with that colorist's needs. 
[0031 ] To define color correction for a scene of a video 
image, a colorist first defines a scene and selects one of 45 
the frames of the scene as a target frame for manual 
manipulation. The image processing system includes a 
user interface that allows the colorist to select hue sec- 
tors for isolation by placing a cursor on a desired loca- 
tion of the target frame. The user interface displays the so 
hue, saturation, and luminance of the sample of pixels 
under the cursor. The user interface also displays quali- 
fication curves about these hue, saturation, and lumi- 
nance values. The colorist may then adjust the 
qualification curves to define the shape and size of the ss 
hue sector that defines the color correction region. The 
qualification curves defined about the hue, saturation, . 
and luminance values displayed on the user interface 



determine both a hue sector to receive color correction 
and a qualification curve establishing the percent of 
color correction to be applied over the hue sector. 
[0032] The user interface also allows the colorist to 
select corrected color values for each hue sector. Each 
color correction block blends the input color values with 
the corrected color values on a pixel-by-pixel basis 
through application of an alpha qualifier in an alpha 
mixer. The alpha qualifier reflects the product of the 
hue, saturation, and luminance qualifiers for a particular 
pixel's color value, where each qualifier is a point on a 
corresponding qualification curve. The final alpha quali- 
fier may also reflect an additional alpha filter qualifier 
that further modifies the product of the hue, saturation, 
and luminance qualifiers. The final alpha qualification 
curve typically includes a full color correction zone 
around the hue, saturation, and luminance values of the 
sample of pixels under the cursor. In this full color cor- 
rection zone, the color value of the output signal is equal 
to the corrected color value. That is, the input color 
value is are completely replaced by the corrected color 
value for input color values that fall within the full color 
correction zone. 

[0033] The final alpha qualification curve also included 
transition zones within the hue sector but outside of the 
full color correction zone. In the transition zones, the 
alpha mixer uses the alpha qualification curve to blend 
the input color values with the corrected color values set 
by the colorist. For a given pixel, the output color value 
is computed as a weighted sum of the input color value 
and the corrected color value, where the alpha qualifier 
defines the weighting coefficients. The alpha mixer thus 
permits smoothing of the color correction, or a gradual 
reduction in the amount of color correction applied at 
the edges of the hue sector. As a result, the output color 
values typically include increasing amounts of the input 
color values as the hue-domain color parameters (hue, 
saturation, and luminance) diverge from the hue- 
domain values of the sample of pixels under the cursor. 
Because the colorist may define the hue, saturation, 
and luminance qualifiers independently, the blend at the 
edges of the hue sector may be based on hue, satura- 
tion or luminance, or a combination of these parame- 
ters. As noted previously, an additional alpha filter may 
further shape the final alpha qualifier applied by the 
alpha mixer. 

[0034] Each color correction block allows the colorist 
to define qualifiers and color correction values for up to 
sixteen non-overlapping hue sectors, which are also 
referred to as color correction channels. As an addi- 
tional option, the user interface allows the colorist to 
define one or more geometric constraints for each color 
correction channel. For example, a geometric constraint 
may be a window that restricts the application of color 
correction for the corresponding hue sector to the por- 
tion of the frame inside, or alternatively outside, the win- 
dow. Geometric constraints allow the colorist to limit the 
automatic application of color correction to a defined 
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portion of the frame area, over the several frames of a 
scene. Geometric constraints therefore increase the 
system's ability to isolate discrete objects in a video 
scene for color correction. 

[0035] Once the colorist is satisfied with the color cor- 
rection defined for the target frame, the color correction 
system automatically applies the color correction 
parameters defined for the target frame to the other 
frames of the scene. That is, the color correction system 
isolates color correction regions in each frame of the 
scene using the qualification curves defined for the tar- 
get frame. The system also mixes the corrected color 
values defined for the target frame with the input color 
values of each frame of the scene using the qualification 
curves defined for the target frame. Specifically, the 
color correction system applies the corrected color val- 
ues to the isolated regions by mixing the input color val- 
ues with the corrected color values on a pixel-by-pixel 
basis through application of an alpha qualifier in the 
alpha mixer. The steps are repeated for other scenes in 
the film or video tape, often with different correction set- 
tings stored for different scenes. This process may be 
repeated as needed to create a color corrected master 
film or video tape that reflects multiple color adjust- 
ments to multiple frames in multiple scenes. 
[0036] Although the disclosed embodiment of the 
invention is described in the context of a scene-by- 
scene digital color correction system, those skilled in 
the art will understand that the invention is not limited to 
video color correction, but may be equally useful in 
other types of color image processing in which there is 
a need for region isolation, such as image compression, 
image filtering, noise suppression, animation, and many 
other image processing techniques. The invention is 
particularly useful in an image processing application in 
which there is a need to define a first region of an image 
for receiving one type of data processing, and another 
region for receiving a different type of data processing. 
The disclosed embodiment, however, is specifically tai- 
lored to operate as a scene-by-scene color correction 
system in which several frames defining a scene of a 
video program may receive automatic color corrections 
defined for a selected target frame of the scene. Thus, 
the disclosed embodiment is particularly useful as a 
color correction or color enhancement system for video 
programs, including motion pictures, television pro- 
grams, video-taped recordings, and the like. 
[0037] Certain methods associated with the disclosed 
embodiment are presented in terms of exemplary dis- 
play images, algorithms, and symbolic representations 
of operations of data within the computer's memory. As 
known to those skilled in the programming arts, these 
are typical techniques used by those skilled in the art of 
computer programming and computer construction to 
convey teachings and discoveries to others skilled in the 
art. The description of the methods involved in the 
present invention include numerous details, such as 
computer display system elements, aspects of compu- 



ter program user interfaces, display screens and for- 
mats, sample data, and so forth, in order to provide an 
understanding of the invention. Nevertheless, those 
skilled in the art will understand that the invention may 

5 be practiced without these specific details. In addition, 
well-known circuits, programming methodologies, and 
structures utilized in the present invention may not be 
described in detail to avoid obscuring the inventive 
aspects of the disclosed embodiments. 

w [0038] For purposes of this discussion, an "algorithm" 
is generally a sequence of computer-executed steps 
leading to a desired result. These steps require physical 
manipulations of physical quantities. Usually, though not 
necessarily, these quantities take the form of electrical, 

15 magnetic, or optical signals that may be stored, trans- 
ferred, combined, compared, or otherwise manipulated. 
Those skilled in the art typically refer to these signals as 
bits, values, elements, symbols, characters, images, 
terms, numbers, or the like. It must be understood that 

20 no involvement of a human operator is necessary or 
even desirable in many aspects of the present invention, 
since the operations described (except those specifi- 
cally identified as originating with the operator, user, or 
colorist) are machine operations performed in conjunc- 

25 tion with a human operator that interacts with the com- 
puter. 

[0039] Furthermore, it should be kept in mind that 
there is a distinction between the methods, steps, or 
operations carried out by a computer, and the method of 

30 computation itself. The present invention does not 
involve methods of computation. The invention rather 
relates to methods, steps, or operations for a computer 
processing electrical or other physical signals, generat- 
ing desired physical signals, and displaying results and 

35 user interfaces. As shown in FIG. 1 , the present inven- 
tion relates to a system 10 for performing these opera- 
tions. 

[0040] It should be further understood that the opera- 
tions described in this specification are not related or 

40 limited to any particular computer or apparatus. Rather, 
various types of general purpose or specialized 
machines may be used with programs constructed in 
accordance with invention. These machines may be 
general purpose digital computers, application-specific 

45 integrated circuits, parallel-processing hardware, neural 
networks, or other types computing devices. Neverthe- 
less, it is considered advantageous to construct a spe- 
cialized apparatus to perform the operations associated 
with the invention using parallel-processing circuitry, 

so such as' programmable logic units (PLUs), field-pro- 
grammable gate arrays (FPGAs), or other types of 
reprogrammable parallel-processing hardware. 

Image Processing System 

55 

[0041] Referring now to the drawings, in which like 
numerals indicate like elements or steps throughout the 
several figures, FIG. 1 illustrates an image processing 
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system 1 0 constructed in accordance with an illustrative 
embodiment of the present invention. The image 
processing system 10 is suitable for processing video 
data by carrying out primary color manipulation using 
secondary color correction region isolation. The image 
processing system 10 includes several basic compo- 
nents: a computer-based workstation 12 including mon- 
itor 15 and keyboard 20, a colorist's control panel 25, a 
digital color correction system 30, a source of video 
images 32, a video display 40, and a computer storage 
medium for processed images 42. The workstation 12 
preferably includes pointing devices, such as a mouse 
18 and/or graphics tablet 19. The workstation 12 is cou- 
pled for data communications via a network connection 
22, preferably a high speed network such as an Ether- 
net, to the color correction system control panel 25 and 
the color correction system 30. 
[0042] The source of images 32 may be an analog 
source, such as a telecine or video tape player, or the 
source may be a digital video storage medium. The 
source is connected to an input circuit board 31 in the 
color correction system 30, which converts analog input 
signals to digital signals if necessary. The image signals 
internal to the color correction system 30 are digital, and 
are stored and manipulated in a digital video format, 
such as the International Radio Consultant Committee 
(CCIR) promulgated Recommendation No. 601-1 
(1986), which is incorporated into this specification by 
reference. The standard signals defined in Recommen- 
dation 601-1 essentially consist of a luminance signal Y 
and two color difference signals (R-Y) and (B-Y). It is 
well known that, since the luminance signal contains 
information on levels of red, green, and blue (R.G.B), 
the three standard 601-1 signals can be used to repro- 
duce the R,G.B levels for any given set of samples. 
The color correction system 30 converts the 601-1 sig- 
nals to corresponding signals in the primary color 
domain (i.e., digital R,G,B signals). The color correction 
system 30 then manipulates the resultant signals in the 
primary color domain. The corrected or modified signal 
can then be passed through a signal matrix to convert 
the modified digital signal to an analog format suitable 
for storage on a medium, such as video tape, that may, 
in turn, be used to drive an analog display device, such 
as a television or other video display. The color correc- 
tion system 30 also includes an output circuit board 35 
that typically converts the digital signals within the color 
correction system into analog form for immediate dis- 
play to the operator of the system. Thus, the output cir- 
cuit 35 is coupled via a video signal cable 37 to a video 
monitor 40 and to a utilization device 42, such as a 
video tape recorder or other image storage device. 
Alternatively, the corrected digital signals can be stored 
in digital form in a digital data storage device coupled to 
the system. 

[0043] Because the image source 32 is located down- 
stream from the SGI workstation 12, and the worksta- 
tion uses color data to isolate color correction regions, 



the image processing system 10 includes mechanism to 
provide an input color video signal to the workstation. 
This mechanism is a splitter 104 that divides the signal 
of the output video cable 37 to provide the input color 

s video signal for the workstation 12. One output of the 
splitter 104 is connected via an input video signal cable 
102 to the SGI workstation 12. The other output of the 
splitter 1 04 is connected via the output video cable 37 to 
the video monitor 40 and utilization device 42. 

10 The preferred graphics tablet 19, which is particularly 
useful for certain manipulations of geometric con- 
straints, is a Wacom ArtPad™ or ArtZ™ graphics tablet 
manufactured by Wacom Technology Corporation, Van- 
couver, WA 98661. 

15 [0044] The preferred workstation 12 is an INDY™ 
model workstation manufactured by Silicon Graphics, 
Inc. (SGI). The preferred workstation includes an R4600 
RISC processor operating at least at 133 MHz, internal 
24-btt XL color graphics (with R,G,B single- or double- 

20 buffer color indices), a digital video input port capable of 
storing 640 x 480 x 30 fps to memory, 2 serial and 1 par- 
allel data port, an Ethernet network port, a fast SCSI-2 
data port, at least 32 megabytes of RAM, and a 1.0 or 
larger Gb hard disk. The workstation 12 also includes 

25 an on-board display driver circuit, namely, the 24-bit XL 
color graphics circuitry with R.G.B double-buffer color 
indices, which provides video signals to at least one 
workstation monitor 15. A separate, second video mon- 
itor displays a target image, typically a full-screen repre- 

30 sentation of the video image being processed by the 
system. Optionally, a different SGI model workstation 
may be employed, for example one including a video 
adapter card that drives multiple monitors. If a worksta- 
tion model is employed that supports multiple monitors, 

35 the second monitor may also be connected to the work- 
station. Further details of the preferred workstation are 
available in the literature supplied by the manufacturer. 
[0045] The preferred color correction system 30 is a 
Da Vinci RENAISSANCE 8:8:8™ digital color corrector 

40 manufactured by Da Vinci Systems, Inc., Ft. Lauderd- 
ale, Florida (assignee of the present application). This 
color correction system 30, which is coupled to the con- 
trol panel 25, includes various circuit board components 
that carry out digital video signal processing. The pre- 

45 ferred RENAISSANCE 8:8:8™ control panel 25 includes 
three separate panels, each having a combination of 
dedicated keys, soft keys, and soft knobs that provide 
many simultaneous functions utilized in the color cor- 
rection process. A dedicated keyboard 50 contains both 

so dedicated and soft keys for system feature control, dis- 
play/list management, source and destination motion 
control, editing, special effects features, and the like. 
This keyboard also contains a slide-out alphanumeric 
keyboard (not shown) to enter names, comments, and 

55 other important session information. Included on this 
control panel is a "User Definable Windows" (UDW) but- 
ton or key 51 that is utilized to activate the certain func- 
tion, such as those associated with defining geometric 
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constraints. 

[0046] The preferred RENAISSANCE 8:8:8™ system 
includes software that is operative for controlling the 
image source and destination, and reading and storing 
frame numbers in association with user-defined scene 
identifiers or names. Thus, the system can display 
scene lists that facilitate the user in associating scene 
identifiers or names with selected frames from the 
scenes. In addition, the system includes control circuitry 
responsive to a house clock for triggering frame buffers 
and other video signal control devices to synchronize 
multiple video signals simultaneously under the sys- 
tem's control. This allows multiple versions of the same 
scene, such as modified and unmodified versions, to be 
synchronized for simultaneous display or combined 
processing. 

[0047] The control panel 25 also includes a joyball 
panel 53, which includes knobs, a trackball 54 for 
manipulating a cursor, keys for source setup, primary 
color balance, color grabbing, trackball control, and 
other effects control. When the windows feature of the 
present invention is activated, movement of the trackball 
54 causes generation of a cursor 60 that is displayed on 
the video monitor 40. The cursor 60 is utilized to manip- 
ulate and select portions of video images displayed on 
the monitor, as will be described. 
[0048] Finally, the control panel 25 includes a soft 
panel 57, which contains knobs and softkeys for dedi- 
cated 6-color secondary enhancement, special effects 
control, dedicated memory keys, and other functions 
not forming a part of the present invention. In accord- 
ance with the invention, the control panel 25 includes 
features to facilitate primary color correction and sec- 
ondary color correction region isolation, the definition of 
geometric constraints, and the definition of multiple sets 
of primary color correction parameters (e.g., one for 
regions inside a geometric constraint and one for 
regions outside the constraint). These and other param- 
eters may be set and stored in memory by manipulation 
of controls on the soft panel 57. 
[0049] The color correction system 30 includes sev- 
eral circuit boards that perform the functions required to 
carry out color correction and other types of image 
processing in digital color images, and to control input 
from the image source 32 and utilization or storage in 
the utilization device 42. These circuits include a real 
time controller (RTC) circuit 70 with network interface 
that provides a data communication network interface to 
the data communication network 22 coupling the color 
correction system 30 to the workstation 12 and color 
correction system control panel 25. 
[0050] The real time controller (RTC) 70 includes a 
dedicated microprocessor for handling real time events. 
Real time events occur at the rate of one every 30 milli- 
second (ms), so as to maintain an event rate corre- 
sponding to at least a 33 frames per second (fps) 
display rate. The RTC 70 receives an events via the 
data communications network 22 to control various 



functions of the system, for example providing a set of 
color corrections for each frame of a specified. In partic- 
ular, the events list includes a data structure that identi- 
fies a particular frame number and scene number, 

5 information that specifies one or more sets of color cor- 
rection parameters for the selected frame, hue-domain 
information for isolating color correction regions, infor- 
mation defining one or more geometric constraints for 
the frame, information identifying which color correc- 

10 tions are associated with which hue-domain region and 
geometric constraint, and so forth. 
[0051 ] The events list is a data structure having frame 
numbers as a time reference. The data structure 
includes a sequence of data blocks in which each block 

15 is related to a beginning frame number and an ending 
frame number. Each block is called a "scene," which 
typically corresponds to a continuous segment of film or 
video shots. Each block also contains a set of color cor- 
rection parameters, hue-domain isolation parameters, 

20 and geometric constraint information for the frame. 
[0052] A user definable windows (UDW) generator 
board 75 includes a dedicated high speed microproces- 
sor that converts vectorized user-defined windows into 
a video matte or geometric constraint on a real time 

25 basis at the real time event rate. The RTC circuit 70 pro- 
vides the vector representations of the windows to the 
UDW board 75 at the real time event rate. 
[0053] A key frame buffer (KFB) circuit board 78 stores 
a video image from the image source 32, or from any 

30 other digital storage system, in a high speed memory. 
This image is then utilized in to derive a vector repre- 
sentation of any user defined windows. Keys for vector- 
izing may be obtained directly from the image source 
32, or may be retrieved from prestored images stored in 

35 the memory of the workstation 1 2. 

[0054] Color correction equipment 80 carries out dig- 
ital color correction and other video parameter adjust- 
ment functions associated with the color correction 
system 30. The block in FIG. 1 identified as the color 

40 correction equipment 80, which includes all of the 
remaining functions of the preferred RENAISSANCE 
8:8:8™ digital color correction system 30, is described in 
greater detail with reference to FIGS. 2-14. Briefly, the 
color correction equipment 80 receives color correction 

45 parameters that define the coefficients of a transforma- 
tion matrix or "T-matrix" that is applied to an input 
R.G.B, signal to produce a color corrected output R.G.B 
signal. The input R.G.B signal and the output R.G.B sig- 
nal from the T-matrix process are combined within an 

so "alpha mixer" that restricts that application of the color 
corrections defined in the T-matrix to color correction 
regions defined in the hue-domain through hue, satura- 
tion, and luminance qualification curves. The hue, satu- 
ration, and luminance qualification curves are non- 
55 additively combined to produce a total qualification 
curve. An additional alpha filter may further modify the 
total qualification curve to produce the final alpha quali- 
fication curve that is applied by the alpha mixer. For a 



9 



7/12/2007, EAST Version: 2.1.0.14 



17 



EP0 947 956 A2 



18 



given pixel, the output color value is computed as a 
weighted sum of the input color value and the corrected 
color value, where the alpha qualifier (i.e.. a point on the 
alpha qualification curve) defines the weighting coeffi- 
cients. 

[0055] Thus, the preferred color correction system 30 
is operative to receive video images from an image 
source such as telecine 32, digitize the video images, 
capture a digitized image in the KFB board 78, display 
the captured image on the video monitor 40, receive 
color corrections entered by the colorist or operator via 
the control panel 25, impose these color corrections 
upon video images as they are transferred through the 
system, and provided corrected output signals via the 
output board 35. These output signals are employed or 
stored in a utilization device 42 and/or simultaneously 
displayed on the video monitor 40. 
[0056] In carrying out the operations for applying 
image processing to an input video signal, a system 
operator or colorist interacts with the system through 
the control panel 25, and via the user interface elements 
of the workstation 12, including the keyboard 20, mouse 
18. graphics tablet 19, and workstation monitor 15. In 
particular, the workstation 12 executes computer pro- 
grams for carrying out the computer-implemented meth- 
ods described in this specification, and generates 
displays on the monitor 15 windows containing user 
interface elements, such as informational displays, con- 
trol buttons, slider bars, data entry fields, image display 
areas, etc. 

[0057] The reader should be careful here to distin- 
guish user-interface "windows" displayed on the monitor 
15 generated from execution of computer software for 
carrying out the invention, from the "user-defined win- 
dows" for applying image processing. During system 
use, the workstation monitor 15 typically displays one or 
more user-interface windows for carrying out the meth- 
ods as described herein. One such user-interface win- 
dow is a control window 44, which includes a display of 
various buttons and slider controls for manipulation of 
the key image. Activation of certain commands causes 
the display of other, secondary windows. One of the 
secondary windows is a View/Edit Window 46, shown 
overlapping the control window 44 in FIG. 1. The 
View/Edit Window 46 is used to display a captured 
image in greater detail, and to provide certain additional 
user controls specifically associated with editing of the 
image. 

[0058] It should be noted that the video image dis- 
played in the video monitor 40 can be displayed within a 
defined View/Edit window 46 if desired. Since the 
images provided from the image source are digitized for 
processing in the preferred RENAISSANCE 8:8:8™ 
processing system, the system can readily generate 
digitized video images and provide them in an appropri- 
ate format, such as Apple Computer's Quicklime™ 
video format, MPEG I or I!, or other digital video format 
via the network 22 to the workstation 12. Accordingly, 



any of the displays that are described as being shown 
on the video monitor 40 can alternatively be displayed 
on the workstation monitor 15. Furthermore, any of the 
functions or displays described in conjunction with the 
5 video monitor 40 can also be supplied in a window in the 
workstation display 15. 

[0059] It is to be expected that, as more and more 
image processing of film and video is conducted in the 
digital domain as opposed to the traditional analog 

10 domain, methods of the present invention will be utilized 
in strictly digital systems for image storage, retrieval, 
manipulation, display, and output. In the disclosed 
embodiment, however, the results of image processing 
are viewed on a conventional analog video monitor 40, 

is while the user interface and controls aspects of the 
image processing and the invention are carried out 
through the workstation 12 and its associated monitor 
15. 

20 Overview of C olor correction Methodology 

[0060] FIG. 2 is a schematic block diagram illustrating 
the use of the image processing system 10 for imple- 
menting color correction region isolation using second- 

25 ary color parameters. FIG, 2 illustrates the system 10 
after the colorist has selected an input image including 
a scene from the image source 32 to receive color cor- 
rection. The colorist has also selected a particular target 
frame of the scene to receive manual color correction. 

30 For the example shown in FIG. 2, the frames 110a-n 
define the scene and the frame 1 1 0a is the target frame 
that the colorist has selected for manual adjustment. As 
the colorist adjusts the target frame 110a, this frame is 
typically displayed on the video monitor 40 while a color 

35 correction user interface 1 20 is displayed on the work- 
station display 15. The color correction user interface 
120 is described in greater detail with reference to 
FIGS. 5 and 6A-B. 

The colorist operates the various controls of the image 

40 processing system 1 0, represented by the control panel 
25, to manually enter color corrections for the selected 
frame 110a. This process includes isolating color cor- 
rection regions within the input image, defining color 
correction parameters that establish the corrected 

45 colors for the color correction regions, and defining an 
alpha qualification curve, which is a smoothing function 
for blending the input color values with the corrected 
colors selected by the colorist. Once the colorist is sat- 
isfied with the color corrections for the selected frame 

so 110a, the color correction equipment 80 automatically 
applies these color corrections to the remaining scenes 
of the frame without the colorist having to manually 
adjust each frame of the scene. 
As noted previously, automatically isolating a color cor- 

55 rection region presents a difficult technical problem 
because the region of interest typically changes in size, 
shape, location, and/or geometry over the frames in a 
scene. For example, in the example shown in FIG. 2, a 
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bottle 100 is lifted, tilted, moved toward a glass 105, 
turned toward the viewer, and then further tilted to pour 
the contents of the bottle into a glass. In this scene, the 
geometry of the bottle 100 changes from a side view of 
the bottle to a top view of the bottle. The bottle also 
changes in location and size over the several frames of 
the scene. The color correction equipment 80 imple- 
ments an improved method for automatic color correc- 
tion region isolation over the frames of the scene so that 
the color corrections defined by the colorist for the 
selected frame 1 1 0a are properly applied to the remain- 
ing scenes of the frame. 

The image processing system 10 typically receives 
image data from the image source 32 in a primary color 
domain, such as 24-bit R,G,B or in the format specified 
by CCIR Recommendation No. 601-1. Isolating color 
correction regions by manipulating the primary color 
domain parameters, however, often produces unsatis- 
factory results. For this reason, color correction systems 
may apply color corrections by transforming the source 
image into a secondary color domain, applying color 
correction parameters in the secondary color domain, 
and then transforming the corrected image back to the 
primary color domain. In particular, the R,G,B source 
image may be linearly transformed into the hue domain, 
which includes hue, saturation, and luminance parame- 
ters. The relationship between color values in the pri- 
mary color domain and in the hue domain is described 
in greater detail with reference to FIG. 3. 
[0061] But applying color corrections in the hue 
domain is computationally expensive and often intro- 
duces color artifacts into the color corrected image. The 
color correction equipment 80 within the system 10 
avoids this problem by isolating color correction regions 
using qualification curves defined the hue domain. The 
color correction parameters for these regions, however, 
are defined in the primary color domain. The qualifica- 
tion curves also serve as smoothing functions for blend- 
ing the input color values with the color correction 
parameters selected by the colorist. That is, the qualifi- 
cation curves are non-additively combined, optionally 
with an additional alpha filter, to produce an alpha qual- 
ification curve that the color correction equipment 80 
uses to blend the input image with the color correction 
parameters selected by the colorist. The color correc- 
tion equipment 80 performs the blending operation, 
which is referred to as "alpha mixing," using the input 
color values and the corrected color values in the pri- 
mary color domain. 

To define a color correction region, the colorist places 
the cursor 60 on a sample of the selected frame 110a. 
This sample may be a single pixel or a number of pixels 
that the color correction equipment 80 averages to 
obtain a representative set of color values. In either 
case, the sample may be represented by a set of color 
parameters preferably expressed by the hue domain 
parameters hue, luminance, and saturation. These color 
parameters for the sample are then displayed within the 



user interface 120 on the workstation display 15. The 
user interface 120 allows the colorist to define a hue 
qualification curve about the hue of the sample, a satu- 
ration qualification curve about the saturation of the 

5 sample, and a luminance qualification about the lumi- 
nance of the sample, as represented by the three trape- 
zoidal curves shown on the user interface 120. 
[0062] The colorist uses the control panel 25 to select 
corrected color values for the sample and to manipulate 

10 the qualification curves as desired. The colorist may 
also use the control panel 25 to define an additional 
alpha filter and a geometric constraint for the selected 
sample. The result of the color corrections entered by 
the colorist for the target frame 110a is typically dis- 

15 played on the video display 40. The colorist may then 
repeat the process for another sample of the target 
frame 110a until all of the desired color correction have 
been entered, or until all of the color correction channels 
available in the system 1 0 are occupied. Once the color- 

20 ist is satisfied with the color corrections for the target 
frame 1 1 0a, the color correction equipment 80 automat- 
ically applies these color corrections to the remaining 
scenes of the frame. The colorist repeats this process 
as needed to create a color corrected master film or 

25 video tape that reflects multiple color adjustments to 
multiple frames in multiple scenes. 

Relationship Petween Primary and Secondary 
Color Domains 

30 

[0063] FIG. 3 (prior art) is a diagram 300 illustrating 
the relationship between the additive primary colors, a 
color wheel, and a color bar. Video display and projec- 
tion systems typically operate using the additive primary 

35 colors, red, green, and blue. For example, a typical 24- 
bit color value in the primary color domain includes an 
8-bit red parameter, an 8-bit green parameter, and an 8- 
b'rt blue parameter. These three color parameters may 
be combined in varying intensities to produce 256 differ- 

40 ent colors values. When ail three primary colors are 
combined in full intensity, they produce the whitest color 
that the device displaying the signal can produce. The 
absence of all three primary colors produces the black- 
est color that the device displaying the signal can pro- 

45 duce. Between these two extremes, the three primary 
colors in equal proportions produce various shades of 
gray, depending on the intensity of the primary color 
constituents. Non-equal proportions of the primary 
colors produce all of the other colors that the device dis- 

so playing the signal can produce. For example, red and 
green may be combined in equal proportions to produce 
yellow, green and blue may be combined in equal pro- 
portions to produce cyan, and blue and red may be 
combined in equal proportions to produce magenta, 

55 and so forth. 

[0064] The colors of the visible spectrum may be plot- 
ted in increasing wavelength (decreasing frequency) on 
a color circle 302, which begins in the magenta region, 
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starting at about 400 millimicrons wavelength at zero 
degrees, and continues around the circle to the red 
region, ending at about 700 millimicrons wavelength at 
360 degrees. The hue of a particular color represents 
the relative proportions of the primary-color constituent, s 
As such, the hue may be represented by a particular 
angle 304 on the color circle 302. Just as may be grays 
may be displayed in varying intensities, so may every 
other hue that a display device can produce. The outer 
edge of the color circle 302 represents the highest- 
intensity value of each hue, and the center of the circle 
represents black or the absence of all three primary- 
color constituents. The relative intensity, or saturation, 
of a color value having a particular hue may therefore be 
represented as the length of a vector 306 displayed and 
the angle 304 representing the hue. 
[0065] In some cases, it is more convenient to "roll 
out" the color circle 304 to produce a color bar 308, also 
known as a rainbow. In this color bar, the zero degree 
point of the color circle 302 is typically displayed at the 
left edge of the color bar, and the 360 degree point is 
typically displayed at the right edge of the color bar. 
Thus, the color bar 308 extends horizontally, from left to 
right, beginning in the magenta region at about 400 mil- 
limicrons wavelength, and ending in the red region at 
about 700 millimicrons wavelength. The hue 304 of a 
color value may therefore be represented as a horizon- 
tal position along the color bar 308. In addition, the 
height of the color bar 308 represents the saturation 
scale, with black at the bottom of the bar and the full- 
intensity values at the top of the bar. This allows the sat- 
uration 306 of a color value to be represented by the 
height of a vector displayed at the horizontal position 
representing the hue. 

[0066] FIG. 4 (prior art) is a diagram illustrating the 
relationship between color values in the primary color 
domain and in the hue domain. In addition to the hue 
304 (represented as "H") and the saturation 306 (repre- 
sented as "S"), an R,G,B color value in the primary color 
domain also reflects a third parameter, luminance (rep- 
resented as "Y"), which along with the hue and the sat- 
uration fully represent the color value in the hue domain. 
The concept of luminance involves the relative bright- 
ness of the various colors of the visible spectrum as per- 
ceived by the human eye. This phenomenon is 
represented by the luminance curve 320 shown in FIG. 
4. Although the luminance curve 320 shown in FIG. 4 is 
not intended to be precisely accurate, it is indicative of 
the approximate shape of the actual luminance curve, 
which can be found in any number of generally available 
text books that describe color correction technology. 
[0067] An R,G,B color value 322 in the primary color 
domain may be transformed into an H.S.Y color value 
342 in the hue domain through the application of the lin- 
ear transformation matrix 326. That is, the H.S.Y color 
parameters can be computed as weighted sums of the 
R,G,B color parameters, and vice versa. Those skilled 
in the color correction art are familiar computing tech- 



niques for transforming R,G,B color values to H.S.Y 
color values, and then converting the H,S,Y color values 
back to R,G,B, color values. Unlike prior image process- 
ing systems, however, the image processing system 80 
takes advantage of this fluidity of color value represen- 
tation to implement color correction region isolation in 
the hue domain, while mixing input color values and 
color in the primary color domain. 

Color Correction User Interface 

[0068] FIG. 5 is a diagram illustrating the user inter- 
face 1 20 of FIG. 2 in greater detail. In the example illus- 
trated in FIG. 2, the video monitor 40 displays the target 
image, which is the selected frame 110a of the scene 
that the colorist is in the process of color correcting. The 
colorist defines a color correction region by first placing 
the cursor 60 over a sample of the target image. This 
selection causes the workstation monitor 15 to display 
the user interface 120, which includes a hue isolation 
user interface 504, a saturation user interface 506, and 
a luminance user interface 508. 
[0069] The hue isolation user interface 504 displays 
the selected hue 510 (i.e., the hue of the sample) within 
a hue qualification curve 51 2. The selected hue and the 
hue qualification curve 51 2 are displayed within a color 
bar 514 of the type described with reference to FIG. 3. 
The color bar 514 preferably shows the various colors 
represented by the bar, and for this reason is often 
referred to as the rainbow. The height of the color bar 
represents the percent qualification with respect to the 
hue qualification curve 512. The workstation monitor 15 
typically illustrates only a portion of the color bar 514, 
and the colorist may scroll the display of the workstation 
monitor 1 5 to the left or right to cause a different portion 
of the color bar to appear on the monitor. 
[0070] The hue qualification curve 512 is generally 
trapezoidal in shape and defines, at least in part, a hue 
sector in which color correction parameters will be 
applied. The colorist selects a corrected color for the 
hue sector and may alter both the shape the of the hue 
qualification curve 512 and its position along the color 
bar 514. The corrected color value selected by the 
colorist corresponds to the color correction parameters. 
Specifically, the color correction parameters are the 
coefficients of a transformation matrix, referred to as the 
T-matrix," that converts the input color value to the cor- 
rected color value. That is, the input color value multi- 
plied by the "T matrix" produces the corrected color 
value selected by the colorist. 
[0071 ] The saturation isolation user interface 506 dis- 
plays the selected saturation 516 (i.e., the saturation of 
the sample) within a saturation qualification curve 518. 
The selected saturation 516 and the saturation qualifi- 
cation curve 518 are displayed within a saturation bar 
520 having the percent saturation increasing from left to 
right in the horizontal direction, and the percent qualifi- 
cation increasing from bottom to top in the vertical direc- 
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tion. The saturation qualification curve 518 is generally 
trapezoidal in shape and also contributes to the defini- 
tion of the hue sector in which color correction may be 
applied. The colorist may alter both the shape the of the 
saturation qualification curve 518 and its position along 
the saturation bar 520. 

[0072] In similar fashion, the luminance isolation user 
interface 508 displays the selected luminance 522 (i.e., 
the luminance of the sample) within a luminance qualifi- 
cation curve 524. The selected luminance 522 and the 
luminance qualification curve 524 are displayed within a 
luminance bar 526 having the percent luminance 
increasing from left to right in the horizontal direction, 
and the percent qualification increasing from bottom to 
top in the vertical direction. The luminance qualification 
curve 524 is generally trapezoidal in shape and also 
contributes to the definition of the hue sector in which 
color correction may be applied. The colorist may alter 
both the shape the of the luminance qualification curve 
524 and its position along the luminance bar 526. 
[0073] Because the workstation monitor 15 displays 
the hue spectrum within the color bar 514 while the 
video monitor 40 displays the target image, the com- 
bined displays assist the colorist in selecting a hue sec- 
tor that captures a particular object included in the 
target image while avoiding other objects that may have 
similar, but perceptibly different, hues. In addition, the 
colorist may preview the effect of the selected color cor- 
rection on the target frame 110a displayed on the video 
monitor 40. In other words, the colorist may toggle the 
display shown on the video monitor 40 between the 
unprocessed input image and a processed image for 
the scene 1 1 0a to gauge the effect of the selected color 
correction. 

[0074] As mentioned previously, color correction 
region isolation is performed in the hue domain, while 
the color correction itself is performed in the primary- 
color domain. A particular pixel having an R.G.B color 
value has a corresponding H.S.Y color value. The hue 
parameter (H) has a non-zero hue qualifier (i.e.. qualifi- 
cation percent) (c^) if it is between H1 and H2 as shown 
in the hue isolation user interface 504. The hue qualifier 
(%) may typically be determined through reference to a 
look-up table that contains the hue qualification curve 
512. Similarly, the saturation parameter (S) has a non- 
zero saturation qualifier (c^) if it is between S1 and S2 
as shown in the saturation isolation user interface 506. 
The saturation qualifier (a,) may also be determined 
through reference to a look-up table that contains the 
saturation qualification curve 518. And the luminance 
parameter (Y) has a non-zero luminance qualifier (ay) if 
it is between Y1 and Y2 as shown in the luminance iso- 
lation user interface 508. The luminance qualifier (ay) 
may also be determined through reference to a look-up 
table that contains the luminance qualification curve 
524. 

[0075] The hue qualification percent or qualifier (a^, 
the saturation qualifier (aj, and the luminance qualifier 



(cty) may by non-additively combined, for example by 
multiplying the three percentages together, to obtain a 
total alpha qualifier (04) for the particular pixel. The total 
alpha qualifier (04) may be further modified by an 

5 optional alpha filter qualification percentage to produce 
a final alpha qualifier (a) for the pixel. The final alpha 
qualifier (a) is a value between zero and 100 percent 
that determines the relative portions of the input color 
value (Rjn.Gin.Bin) and the corrected color value 

10 (R'.G'.B 1 ) in the output pixel, where (a) represents the 
relative contribution of the corrected color value and (1- 
a) represents the relative contribution of the input color 
value. For example, if the final alpha qualifier (a) is 
equal to 75%, the color value of the output pixel 

15 (R 0 ut.Gout. B out) is be determined by the following alpha- 
mixing formula: 

Rou^.75*^ + .25^ 
20 G flUI -.75'G , + .25*G ln 

B flut «.75*B' + .25*B ln 

[0076] Thus, the final alpha qualifier (a) is used to 

25 determine the weighting parameters for blending the 
input color parameters with the corrected color parame- 
ters by computing the output color parameters as 
weighted sums of the primary-color domain color 
parameters. This type of color blending, referred to as 

30 "alpha mixing," permits smoothing of the color correc- 
tion, or a gradual reduction in the amount of color cor- 
rection applied at the edges of the hue sectors. That is. 
the output signal, which may be a blend of the input sig- 
nal and the corrected color values, typically includes 

35 increasing amounts of the input signal as the hue- 
domain color parameters diverge from the hue. satura- 
tion, and luminance values of the sample pixels under 
the cursor. The amounts of the input signal and the cor- 
rected color values included in the output signal is 

40 defined by the alpha qualifier. As the colorist may define 
hue. saturation, and luminance qualification curves 
independently, the color blend at the edges of the hue 
sector may be based on hue, saturation or luminance, 
or a combination of these parameters. An additional 

45 alpha filter may further influence the alpha qualifier. 
[0077] As an additional option, the colorist may define 
a geometric constraint, represented by the constraint 
528 shown in FIG. 5, in addition to the hue-domain color 
correction region isolation parameters (i.e.. the hue, sat- 

50 uration. and luminance qualification curves) described 
above. The geometric constraint allows color correction 
to be limited to a portion of each frame of the scene 
being processed, where the limited portion is defined 
with respect to the geometric constraint. For the exam- 

55 pie shown in FIG. 5, the color correction defined for the 
bottle 100 may be applied to each entire frame except 
the portion within the constraint 502. This approach pre- 
vents color corrections intended to affect only the bottle 
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100 from also affecting the glass 105. 
[0078J Thus, the geometric constraint 528 allows the 
colorist to limit the automatic application of color correc- 
tion to a defined portion of the frame area, over the sev- 
eral frames of a scene. Geometric constraints therefore 
increase the ability of the color correction equipment 80 
to isolate discrete objects for color correction. In partic- 
ular, the colorist may use a geometric constraint to 
exclude from color correction discrete objects that have 
a similar color to a target object. In the example shown 
in FIG. 5, the bottle 100 is the target object and the geo- 
metric constraint 528 prevents a color correction 
intended for the bottle 100 from also affecting the color 
of the glass 105, which may have a similar color. 
[0079] FIG. 6A is a diagram illustrating a portion of the 
hue isolation user interface 504 in greater detail. The 
slope of the rising and falling edges of the hue qualifica- 
tion curve 512 defines the softness of the color correc- 
tion. The hue qualification curve 512 typically includes a 
full color correction zone 604 at the center of the curve, 
and sloped rising and falling edges toward the outer 
edges of the hue sector. These sloped edges define 
transition zones 606a and 606b towards the edges of 
the hue sector. In the full color correction zone 604, the 
colors of the output signal are equal to the corrected 
color values (i.e., the color values of input signal are 
completely replaced by the corrected color values). For 
the transition zones 606a and 606b, the input color val- 
ues are mixed with the corrected color values in a per- 
centage equal to the hue qualifier (a^, which the 
percent qualification determined by reference to the hue 
qualification curve 512. 

[0080] Each of the qualification curves 51 2, 518, and 
524 may be shaped as shown for the representative hue 
qualification curve 512. In addition, any of the qualifica- 
tion curves 512, 518, and 524 may be set equal to the 
value "one" for its entire horizontal range to effectively 
remove qualification for the corresponding color param- 
eter. Thus, the color correction equipment 80 allows the 
colorist to use hue qualification, saturation qualification, 
or luminance qualification individually to select color 
correction regions. In addition, more then one qualifica- 
tion curve may be applied simultaneously to define a 
color correction region. 

[0081] The color correction equipment 80 is typically 
configured as one or more color correction blocks in 
which each block may be used to define up to sixteen 
non-overlapping hue sectors or color correction chan- 
nels. Accordingly, the hue isolation user interface 504 
typically displays a number of hue qualification curves 
5122a-n, each corresponding to one of the available 
color correction channels. The display shown on the 
workstation monitor 15 typically tracks the active chan- 
nel automatically so that the hue qualification curve cor- 
responding to a channel selected by the colorist 
automatically appears in the center of the workstation 
monitor 1 5. 

[0082] FIG. 6B is a diagram illustrating an alternative 



user interface 608 for operating the color correction 
equipment 80. The user interface 608 collapses the sat- 
uration user interface 506 and the luminance user inter- 
face 508 into compact visual elements that are 

5 conveniently shown in conjunction with their corre- 
sponding hue qualification curve. The top of the user 
interface 608 includes a hue qualification display 610, 
which is shown in this example as having three hue 
qualification curves 612, 614, and 616 displayed 

10 against the background of a color bar 618 of the type 
described with reference to FIG. 3. Recall that each 
color correction block typically includes up to sixteen 
color correction channels. To illustrate a typical scenario 
by taking the hue qualification curves 612, 614, and 616 

15 from left to right, the first hue qualification curve 612 
may correspond to the first color correction channel 
(numbered "1"), the second hue qualification curve 614 
may correspond to the third color correction channel 
(numbered "3"), and the third hue qualification curve 

20 616 may corresponds to the second color correction 
channel (numbered "2"). 

[0083] FIG. 6B shows the hue qualification curves out 
of order with respect to the numbering of the color cor- 
rection channels because the colorist may assign the 

25 color correction channels in any order (e.g., by assign- 
ing different channels to different samples of the target 
frame 110a), whereas the hue qualification display 610 
displays the hue qualification curves in hue order along 
the underlying color bar 618 or rainbow. The hue quali- 

30 f ication curves are, therefore, superimposed against the 
color bar 618 to show the color of their respective hue 
sectors at a glance. The curves are clearly labeled with 
their respective color correction channel numbers so 
that the colorist can determine which controls will affect 

35 which hue qualification curve. This type of display 
allows the colorist to scroll left and right along the color 
bar 618 to see the various hue qualification curves, and 
their associated color correction channel numbers, in 
their respective positions along the color bar 618 . As 

40 noted previously, the colorist may alter the position and 
shape of each hue qualification curve individually. 
[0084] A hue-shift display 620 is located beneath the 
hue qualification display 610. The hue-shift display 620 
includes a first color correction block '622 located 

45 directly below the first hue qualification curve 612. The 
width of the first color correction block 622 is equal to 
the width of the first hue qualification curve 612, which 
sets the width of the hue sector for color correction 
channel number one. The color correction block 622 

so displays the corrected color for color correction channel 
number one. The corrected color is the output color 
value selected by the colorist for input color values that 
produce a final alpha qualifier (a) equal to 100 percent. 
With reference to the previously-defined alpha-mixing 

55 formula, the color correction block 622 displays the cor- 
rected color value (R\G',B') for color correction channel 
number one. 

[0085] Similarly, the hue-shift display 620 includes a 
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second color correction block 624 located directly below 
the second hue qualification curve 614. The width of the 
second color correction block 624 is equal to the width 
of the second hue qualification curve 614, which sets 
the width of the hue sector for color correction channel 5 
number three. The color correction block 624 displays 
the corrected color value (R'.G'.B') for color correction 
channel number three. And the hue-shift display 620 
includes a third color correction block 626 located 
directly below the third hue qualification curve 61 6. The w 
width of the third color correction block 626 is equal to 
the width of the third hue qualification curve 616. which 
sets the width of the hue sector for color correction 
channel number two. As with the other blocks, the color 
correction block 626 displays the corrected color value 75 
(R'.G'.B 1 ) for color correction channel number two. 

[0086] The color correction user interface 608 also 
includes a luminance display 630 on the left-half portion 
of the interface below the hue-shift display 620. The 
luminance display 630 includes three control windows 20 
632, 634, and 636. Each of these control windows may 
display a luminance qualification curve for a particular 
color correction channel, as determined by the colorist. 
For example, the colorist may assign the first luminance 
control window 632 to color correction channel number 25 
one, the second luminance control window 634 to color 
correction channel number two, and the third luminance 
control window 636 to color correction channel number 
three. 

[0087] With these assignments, the first luminance 30 
control window 632 displays a luminance qualification 
curve 638 for color correction channel number one, the 
second luminance control window 634 displays a lumi- 
nance qualification curve 640 for color correction chan- 
nel number two. and the third luminance control window 35 
636 displays a luminance qualification curve 642 for 
color correction channel number three. The colorist may 
manipulate each of these luminance qualification 
curves individually. Note that each luminance qualifica- 
tion curve is rotated 90 degrees with respect to the lumi- 40 
nance qualification curve 518 shown in FIG. 5, so that 
the percent luminance increases from top to bottom in 
the vertical direction, and the percent qualification 
increases from left to right in the horizontal direction. 
[0088] The color correction channel numbers deter- 45 
mine which luminance qualification curve shown in the 
luminance display 630 corresponds to which hue quali- 
fication curve shown in the hue qualification display 
610. In fact, the luminance display 630 may show lumi- 
nance qualification curves that correspond to hue quali- so 
fication curves that are not displayed within the hue 
qualification display 610, if the colorist so desires. 
[0089] The color correction user interface 608 also 
includes a saturation display 650 on the right-half por- 
tion of the interface below the hue-shift display 620. The 55 
saturation display 650 includes three control windows 
652, 654, and 656. Each of these control windows may 
display a saturation qualification curve for a particular 



color correction channel, as determined by the colorist. 
For example, the. colorist may assign the first saturation 
control window 652 to color correction channel number 
one, the second saturation control window 654 to color 
correction channel number two, and the third saturation 
control window 656 to color correction channel number 
three. 

[0090] With these assignments, the first saturation 
control window 632 displays a saturation qualification 
curve 658 for color correction channel number one. the 
second control window 654 displays a saturation qualifi- 
cation curve 660 for color correction channel number 
two. and the third saturation control window 656 dis- 
plays a luminance qualification curve 662 for color cor- 
rection channel number three. The colorist may 
manipulate each of these saturation qualification curves 
individually. Like the luminance qualification curves, 
each saturation qualification curve is rotated 90 degrees 
with respect to the saturation qualification curve 524 
shown in FIG. 5, so that the percent saturation 
increases from top to bottom in the vertical direction and 
the percent qualification increases from left to right in 
the horizontal direction. 

[0091 ] Also like the luminance display 630, the color 
correction channel numbers determine which saturation 
qualification curve shown in the saturation display 650 
corresponds to which hue qualification curve shown in 
the qualification display 610. Again, the saturation dis- 
play 650 may show saturation qualification curves that 
correspond to hue qualification curves that are not dis- 
played within the qualification display 610. if the colorist 
so desires. 

[0092] To allow the colorist to ascertain all of the qual- 
ification information associated with a particular color 
correction channel from a single display, the hue qualifi- 
cation display 610 includes luminance-and saturation- 
related display elements that are shown in association 
with their corresponding hue qualification curves. This 
allows the colorist to view all of the qualification informa- 
tion by scrolling left and right along the color bar 618 to 
display the hue qualification curves with their corre- 
sponding luminance- and saturation-related display ele- 
ments for the various color correction channels. The 
colorist may then stop at any point along the color bar 
618, assign one of the luminance or saturation control 
windows to a particular color control channel, typically a 
displayed channel, and adjust the luminance or satura- 
tion qualification curves as desired. 
[0093] Specifically, the luminance qualification curves 
638, 640, and 642 each have an associated luminance 
display element (664, 666, and 668 respectively) that is 
shown in connection with the corresponding hue qualifi- 
cation curve (612, 616, and 614 respectively). Each 
luminance display element is a narrow band shown 
approximately in the center of its corresponding hue 
qualification curve, which typically is the hue position of 
a sample of the target image selected by the colorist. 
For each luminance display element, the percent lumi- 
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nance increases in the vertical direction over the height 
of the color bar 618. Thus, the vertical extent of each 
luminance display element visually represents the lumi- 
nance range covered by the corresponding luminance 
qualification curve. In addition, the percent luminance is 5 
preferably shown visually within the band. That is, the 
luminance display element contains the hue of the 
underlying color (i.e., the hue corresponding to the hor- 
izontal position of the luminance display element along 
the color bar 618) with varying luminance. In other 10 
words, the luminance of the hue shown within the lumi- 
nance display element increases vertically from bottom 
to top across the luminance display element. 
[0094] In addition, the saturation qualification curves 
658, 660, and 662 each have an associated saturation is 
display element (674, 676, and 678 respectively) that is 
shown in connection with the corresponding hue qualifi- 
cation curve (612, 616, and 614 respectively). Each sat- 
uration display element includes two horizontal lines 
across the corresponding hue qualification curve, 20 
although lines occurring at the top or bottom of the color 
bar 618 may not be shown for convenience. As the color 
bar 618 shows the rainbow in increasing saturation ver- 
tically across the color bar, the horizontal lines of satu- 
ration display elements visually represents the vertical 25 
extent of the saturation range covered by the corre- 
sponding saturation qualification curve. 
[0095] Although the luminance display 630 and the 
saturation display 650 shown in FIG. 6B depict the lumi- 
nance and saturation qualification curves as trapezoids, 30 
those skilled in the art will appreciate that other types of 
figures could equivalently communicate the relevant 
information to the colorist. For example, the displays 
could show only the slope of the rising and falling edges 
(i.e., the transition zones) of a qualification curve. That 35 
is, the potion of the qualification curve that is equal to 
one (i.e., the full qualification zone) need not be dis- 
played. This type display showing only the transition 
zones of a qualification curve would communicate all of 
the relevant information regarding the curve to the color- 40 
ist, who would know that the qualification curve is equal 
to one in the region between the transition zones. 

Colpr Correction Methodology 

45 

[0096] FIG. 7 is a logic flow diagram illustrating a rou- 
tine 700 for operating the color correction equipment 80. 
Throughout the description of routine 700, the com- 
mands received by the color correction equipment 80 
are typically entered by a colorist using the various con- so 
trols of the image processing system 10. In step 702, 
the color correction equipment 80 receives commands 
identifying the start and end frames of a scene of a 
video image to receive color correction. Also in step 
702, the color correction equipment 80 receives a com- ss 
mand selecting one of the frames of the scenes as a tar- 
get frame to receive manual color corrections. The color 
correction equipment 80 automatically applies the color 



corrections entered for the target frame to the other 
frames of the scene, as described below. 
[0097] Step 702 is followed by step 704, in which the 
color correction equipment 80 receives commands 
selecting a sample of the target frame. The sample is 
used as a starting point for defining a color correction 
region. Step 704 is followed by an optional step 706, in 
which the color correction equipment 80 may receive a 
command defining a geometric constraint within the tar- 
get frame. The geometric constraint is used to limit the 
application of color correction associated with the color 
correction region to a portion of the frames of the scene 
defined with riespect to the geometric constraint. For 
example, color correction may only be applied on the 
inside, or alternative on the outside, of the geometric 
constraint within each frame of the scene. 
[0098] Step 706 is followed by another optional step 
708, in which the color correction equipment 80 
receives a command defining an alpha filter. An alpha 
filter is qualification curve that modifies the total alpha 
curve to produce a final alpha qualification curve for the 
color correction region. The total alpha curve is the 
product of the hue, saturation, and luminance qualifica- 
tion curve defined for the color correction region. The 
color correction equipment 80 typically operates on a 
pixel-by-pixel basis by multiplying the alpha filter quali- 
fier for a given pixel by the total alpha qualifier for the 
pixel to obtain the final alpha qualifier. The final alpha 
qualifier is then passed to an alpha mixer for use in 
blending the input color value for a the pixel with the cor- 
rected color value selected for the pixel by the colorist. 
Each of these qualification curves is typically trapezoi- 
dal in shape, although other filter shapes, such as 
square, bell-shaped, and so forth may be used. 
[0099] Step 708 is followed by step 710, in which the 
color correction equipment 80 receives commands 
defining the hue, saturation, and luminance qualification 
curves for the color correction region. The colorist may 
manipulate each of these qualification curves independ- 
ently. Step 710 is followed by step 712, in which the 
color correction equipment 80 receives commands 
defining the corrected color values for the color correc- 
tion region. Step 712 is followed by step 714, in which 
the color correction equipment 80 computes the coeffi- 
cients of a transformation matrix, known as the T- 
matrix," which is used to produce an unqualified color 
corrected image. The alpha mixer mentioned above 
blends the color values of an input image with the color 
values of an unqualified color corrected image in 
accordance with the final alpha qualification curve to 
product a qualified, color-corrected output image. The 
"T-matrix" and the alpha mixer are further described 
with reference to FIG. 12. The mathematics associated 
with the 'T-matrix" is described with reference to FIG. 
13. 

[0100] Steps 704 through 712 provide the color cor- 
rection equipment 80 with information for applying color 
correction to a particular color correction region. These 
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steps, of course, may be performed in a different order 
that is shown in routine 700, and a colorist my repeat 
any or all of the steps as desired. The color correction 
information created in steps 704 through 714 occupies 
one color correction channel of the color correction 
equipment 80. As described previously with reference 
to FIG. 6A, the color correction equipment 80 typically 
includes one or more color correction blocks that each 
provide up to sixteen non-overlapping color correction 
channels. Thus, the colorist may repeat step 704 
through 714 for additional color correction channels. 
[0101] Accordingly, in step 716, the color correction 
equipment 80 receives commands indicating whether 
the colorist intends to enter color correction information 
for another color correction region, and thus occupy 
another color correction channel. If the colorist intends 
to enter color correction information fa another color 
correction region, the "YES" branch is followed from 
step 716 to step 718, in which the color correction 
equipment 80 determines whether another color correc- 
tion channel is available. If another color correction 
channel is available, the "YES" branch is followed from 
step 718 to step 704, and the color correction equip- 
ment 80 receives color correction information for 
another color correction channel. 
[01 02] If the colorist does not intend to enter color cor- 
rection information for another color correction region, 
the "NO" branch is followed from step 716 to routine 
720, in which the color correction equipment 80 applies 
the color corrections defined for the target frame to the 
other frames of the scene. Similarly, if there is not 
another color correction channel available in the color 
correction equipment 80. the "NO" branch is followed 
from step 718 to routine 720, which is described below 
with reference to FIG. 8. Routine 720 if followed by the 
"END" step, which preferably loops to step 702 so that 
routine 700 may be repeated for another scene in the 
motion picture or other video program that the colorist is 
working on. 

[0103] Routine 700 thus allows the color correction 
equipment 80 to receive color correction information for 
a number of color correction channel, each of which cor- 
responds to a non-overlapping color correction region 
defined in the hue domain. Each color correction region 
is ultimately defined by a final alpha qualification curve, 
which the color correction equipment 80 uses as a mix- 
ing function to blend the color values the input images 
with the color values of unqualified color corrected 
images in the primary-color domain. Routine 700 may 
be repeated as needed to create a color corrected mas- 
ter film or video tape that reflects multiple color adjust- 
ments to multiple frames in multiple scenes. In the 
general case, multiple color adjustments may be 
applied to all of the frames of a motion picture or other 
video program. 

[0104] FIG. 8 is a logic flow diagram illustrating routine 
720 for automatically applying color corrections defined 
for a target frame of a scene to the other frames of the 



scene. Routine 720 follows the "NO" branches from 
steps 716 and 718 shown in FIG. 7. In step 802, the 
color correction equipment 80 loads look-up tables for 
the color correction regions defined by the colorist dur- 

5 ing routine 700. This is equivalent to saying that the 
color correction equipment 80 loads look-up tables for 
each color correction channel; and the color correction 
equipment 80 receives the data for the look-up tables 
through controls operated by the colorist, as described 

10 in routine 700. 

[01 05] Step 802 is followed by step 804, in which the 
color correction equipment 80 configures the index gen- 
erator circuit. Step 804 is followed by step 806, in which 
the color correction equipment 80 gets the R,G,B color 

15 values for a frame of the scene to be color corrected. 
Step 806 is followed by step 808, in which the color cor- 
rection equipment 80 loads the color values for the 
frame into a frame buffer, from which the pixels will be 
passed, one by one, through color enhancement equip- 

20 ment, which is preferably constructed using program- 
mable logic units (PLUs), field-programmable gate 
arrays (FPGAs), or other types of reprogrammable par- 
allel-processing hardware. Thus, the color enhance- 
ment equipment typically applies color correction on a 

25 pixel -by-pixel basis as the pixels pass through the cir- 
cuitry of the color enhancement equipment. 
[01 06] Step 808 is followed by step 81 0, in which the 
color correction equipment 80 clocks a pixel from the 
frame buffer through the color enhancement equipment. 

30 Step 810 is followed by routine 812, in which the color 
correction equipment 80 computes a final alpha qualifier 
for the current pixel. Routine 812 is described with refer- 
ence to FIG. 9. Routine 812 is followed by step 814, in 
which the color correction equipment 80 blends the 

35 input color value for the current pixel with the corrected 
color value for the current pixel in accordance with the 
final alpha qualifier for the current pixel. That is, the 
color correction equipment 80 applies color correction 
to the primary-color domain value for the current pixel. 

40 This mixing operation, which is performed by the alpha 
mixer, is described with reference to FIG. 13 A. 
[0107] Step 814 is followed by step 816, in which the 
color correction equipment 80 determines whether 
there is another pixel in the current frame to process. If 

45 there is another pixel in the current frame to process, 
the "YES" branch loops to step 810, in which the color 
correction equipment 80 clocks the next pixel from the 
frame buffer through the color enhancement equipment. 
If there is not another pixel in the current frame to proc- 

50 ess, the "NO" branch is followed to step 818, in which 
the color correction equipment 80 determines whether 
there is another frame in the scene to process. If there 
is another frame in the scene to process, the "YES" 
branch loops to step 806, in which the color correction 

55 equipment 80 gets the color values for the next frame of 
the scene. If there is not another frame in the scene to 
process, the "NO" branch is followed to the "RETURN" 
step 820, which returns to step 722 shown in FIG. 7. 
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Routine 720 thus process each pixel of each frame of 
the scene. 

[0108] FIG. 9 is a logic flow diagram illustrating routine 
812 for computing a final alpha qualifier for the current 
pixel. Routine 812 follows step 810 shown in FIG. 8. As s 
a prerequisite to routine 81 2, the color correction equip- 
ment 80 transforms the R.G.B primary-color-domain 
value for the pixel into an H,S,Y hue-domain color value. 
The color correction equipment 80 then performs the 
operations of routine 812 on the hue-domain color 
value. In other words, the color correction equipment 80 
performs color correction region isolation, as defined by 
routine 812, in the hue domain. 
[0109] In step 902, the color correction equipment 80 
attempts to determine an index number associated with 
the current pixel. The color correction equipment 80 
uses the hue parameter (H) to determine whether the 
pixel occurs within a color correction region defined dur- 
ing routine 700. The index number identifies the hue 
sector or color correction channel associated with the 
current pixel. If the hue of the current pixel falls within 
one of the hues sectors, the color correction equipment 
80 determines an index number that identifies the hue- 
sector or color correction channel for the pixel. The 
index number is then used to access the hue, satura- 
tion, and luminance qualification curves associated with 
the pixel's color correction channel. The index number 
may also be used to access an optional geometric con- 
straint and an optional alpha filter associated with the 
pixel's color correction channel. 
[0110] Step 902 is followed by step 904, in which the 
color correction equipment 80 determines whether it 
successfully identified an index number for the current 
pixel. Stated differently, the color correction equipment 
80 determine whether the pixel occurs within a color 
correction region defined during routine 700. If the color 
correction equipment 80 did not successfully identify an 
index number for the current pixel, no color correction 
should be performed for the current pixel, and the "NO" 
branch jumps to the "RETURN" step 920. 
[0111] If the color correction equipment 80 did suc- 
cessfully identify an index number for the current pixel, 
the "YES" branch is followed to step 906, in which the 
color correction equipment 80 gets a geometric con- 
straint defined for the pixel's color correction channel. 
The geometric constraint allows the colorist to limit the 
automatic application of color correction to a defined 
portion of the frame area. Typically, the geometric con- 
straint tells the color correction equipment 80 to apply 
color correction only for pixels occurring inside, or alter- 
natively outside, the constraint. Geometric constraints 
therefore increase the system's ability to isolate discrete 
objects for color correction. 

[0112] Step 906 is followed by step 908, in which the 
color correction equipment 80 determines whether the 
geometric constraint excludes the current pixel from 
color correction. If the geometric constraint excludes the 
current pixel from color correction, the "YES" branch 



jumps to the "RETURN" step 920. If the geometric con- 
straint does not exclude the current pixel from color cor- 
rection, the "NO" branch is followed from step 908 to 
step 910, in which the color correction equipment 80 
looks up the hue qualifier for the current pixel. Step 910 
is followed by step 912, in which the color correction 
equipment 80 looks up the saturation qualifier for the 
current pixel. Step 912 is followed by step 914, in which 
the color correction equipment 80 looks up the lumi- 
nance qualifier for the current pixel. 
[01 1 3] Step 914 is followed by step 916, in which the 
color correction equipment 80 multiplies the hue, satu- 
ration, and luminance qualifiers to obtain a total qualifier 
for the current pixel. Step 916 is followed by step 918, in 
which the color correction equipment 80 looks up the an 
alpha-filter qualifier for the current pixel and multiplies 
the total qualifier and the alpha-filter qualifier to obtain a 
final alpha qualifier for the current pixel. Step 918 is fol- 
lowed by the "RETURN" step 920, which returns to step 
814 shown on FIG. 4. Routine 812 thus computes a final 
alpha qualifier, which has a value between zero and 100 
percent, for each pixel to be color corrected. 

Color Correction Computer Architecture 

[0114] FIG. 10 is a schematic block diagram illustrat- 
ing the color correction equipment 80, which is part of 
the image processing system 10 shown in FIG. 1. The 
color correction equipment 80 includes color enhance- 
ment equipment 1000. Any perceived difference in con- 
notation between the terms "color correction 
equipment" and "color enhancement equipment" is 
unimportant; these terms have been selected simply to 
provide distinct labels for referring to different compo- 
nents of the color correction equipment 80. The color 
enhancement equipment 1000 typically operates at 66 
mHz. The input video data stream, however, typically 
.propagates at 74 mHz. The color correction equipment 
80 processes a real-time video signal propagating at 74 
mHz even though the color enhancement equipment 
1000 operates at 66 mHz. This is possible because only 
a subset of the input video signal needs to be passed 
through the color enhancement equipment 1000. 
[0115] The frame 1020 illustrates the subset of the 
input video signal that needs to be passed through the 
color enhancement equipment 1000. The frame 1020 
includes a visible raster 1022 defining the image shown 
on a display device, such as a television screen or com- 
puter monitor. The frame 1020 also includes a non-visi- 
ble portion 1024 including horizontal and vertical 
overscan areas, horizontal retrace intervals, a vertical 
blanking interval, and so forth. Only the visible raster 
portion 1022 of the video signal needs to be passed 
through the color enhancement equipment 1000. The 
color correction equipment 80 therefore strips the visi- 
ble raster 1022 out of each frame and passes only the 
pixels of the visible raster through the 66 mHz color 
enhancement equipment 1000. 
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[01 1 6] Accordingly, the color enhancement equipment 
1000 includes an input frame buffer 1002 that receives 
and temporarily stores each frame of the input video 
signal. Each frame of data is then passed through a vis- 
ible raster extracting circuit 1 004 that extracts the visible 5 
raster portion 1022 of the frame. The visible raster por- 
tion 1022 of the frame is then passed through the color 
enhancement equipment 1000, where color correction 
is applied. 

[0117] The non-visible portion 1024 of each frame 
bypasses the color enhancement equipment 1000 as 
part of an unprocessed input video data signal propa- 
gating at 74 mHz. After the color corrected visible raster 
1022 exits the color enhancement equipment 1000, a 
non-visible raster combining circuit 1006 recombines 
the non-visible portion 1 024 of each frame with the color 
corrected visible raster to construct a complete output 
frame of video data. The complete output frame is then 
passed to an output frame buffer 1008, from which the 
frames of the color corrected output video signal are 
clocked out at 74 mHz. 

[01 18] A control circuit 1 01 0 uses a house clock signal 
1012 to control the timing of the various components of 
the color correction equipment 80. The control circuit 
1010 causes the color corrected visible raster to reach 
the non-visible raster combining circuit 1006 at effec- 
tively the same time as the unprocessed input video sig- 
nal. As a result, the non-visible raster combining circuit 
1006 reassembles each frame properly. Because the 
ratio of the data in the visible raster 1022 to the data in 
a complete frame 1020 is equal to or less than the ratio 
of the 66 mHz data propagation rate through the color 
enhancement equipment 1000 to the 74 mHz data prop- 
agation rate of the unprocessed input video signal 
(about 89%), the color correction equipment 80 can per- 
form the required timing operation. 
[0119] FIG. 11 is a schematic block diagram illustrat- 
ing the color enhancement equipment 1000, which may 
include a number of discrete color correction blocks 
H00a-n arranged in series or parallel. Each color cor- 
rection block typically allows a colorist to define up to 
sixteen non-overlapping hue sectors (i.e., color correc- 
tion channels) with associated corrected color values 
and qualification curves. Each color correction block 
has two video inputs, a first input connected to the out- 
put from the previous block, and a second input con- 
nected to an unprocessed video signal. Delay buffers 
1104a-n are positioned in the unprocessed video signal 
between each color correction block to synchronize the 
unprocessed video signal with the output video signal 
from the preceding color correction block. The control 
circuit 1 01 0 uses the house clock signal 1 01 2 to control 
the timing of delay buffers 1 1 04a-n to maintain synchro- 
nism between the unprocessed video signal and proc- 
essed video signal passing through the various color 
correction blocks 1 1 0Oa-n. 

[0120] FIG. 12 is a schematic block diagram of a rep- 
resentative color correction block 1100. The color cor- 



rection block 1100 includes a video multiplexer 1202 
that operates as a switch allowing the colorist to select 
either the unprocessed video input signal 1204 or the 
output of the previous block 1 206 as the input video sig- 
nal 1208 for the block. Thus, the color correction blocks 
1100a-n may be applied separately (i.e.. in parallel) or 
in tandem (i.e., in series) for each scene processed. In 
addition, a particular colorist may select the number of 
color correction blocks 1 1 02a-n in the system in accord- 
ance with that colbrist's needs. Because the color cor- 
rection blocks 1100 operate on the input video signal 
1 208 on a pixel-by-pixel basis, the operation of the color 
correction block 1100 is described below with reference 
to a given pixel. Each pixel of the input video signal 
1208 is processed in a similar fashion. 
[0121] The color correction blocks 1100 includes an 
R.G.B to H.S.Y transformation circuit 1210 that converts 
the color value for a given pixel of the input video signal 
1208 from the primary color domain (R.G.B) to the hue 
domain (H,S,Y). Specifically, the R.G.B to H.S.Y trans- 
formation circuit 121 0 computes the H,S,Y color param- 
eters as weighted sums of the R.G.B color parameters 
in a manner well known to those skilled in the color cor- 
rection art. The hue parameter H for the given pixel is 
passed to an index generator circuit 1212 that deter- 
mines whether the pixel occurs within a color correction 
channel (i.e., hue sector) defined for the color correction 
block 1100. if the pixel occurs within a color correction 
channel defined for the color correction block 1100, the 
index generator circuit 1212 produces an index number 
identifying the pixel's color correction channel. If the 
pixel does not occur within a color correction channel 
defined for the color correction block 1100, the given 
pixel passes through the color correction block 1100 
without any alteration. Therefore, the color correction 
block 1100 does not introduce color artifacts into por- 
tions of the input video signal 1208 that are not color 
corrected. 

[01 22] The index number for the given pixel identifies 
the proper qualification curves for the pixel. Each quali- 
fication curves is a linear relationship between percent 
qualification (i.e., qualifier value) and a hue-domain 
color parameter. If the given pixel does occur within a 
color correction channel defined for the color correction 
block 1100. the pixel's index number is passed to a hue 
look-up table 1216, a saturation look-up table 1218, and 
a luminance look-up table 1220. The look-up tables are 
configured with the hue qualification curves, the satura- 
tion qualification curves, and the luminance qualification 
curves for the various color correction channels, as con- 
trolled by a user control interface 1214. 
[0123] The hue look-up table 1216. the saturation 
look-up table 1218, and the luminance look-up table 
1220 are connected to a hue ramp 1222, a saturation 
ramp 1224, and a luminance ramp 1226, respectively. 
The hue ramp 1222 receives the hue parameter H from 
the R.G.B to H.S.Y transformation circuit 1210; the sat- 
uration ramp 1224 receives the saturation parameter S 
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from the R.G.B to H,S,Y transformation circuit; and the 
luminance ramp 1226 receives the luminance parame- 
ter Y from the R,G,B to H.S.Y transformation circuit. 
[0124] The hue qualification curve for the pixel is 
passed from the hue look-up table 1 21 6 to the hue ramp 
1222, which determines the hue qualifier (o^) for the 
pixel. The hue qualifier (a h ) is a discrete number with a 
value between zero and 100 percent that may be ascer- 
tained from the hue qualification curve. That is, given 
the hue parameter H for the given pixel, the hue ramp 
1222 determines the hue qualifier (o^) directly from the 
hue qualification curve. Similarly, the saturation qualifi- 
cation curve for the pixel is passed from the saturation 
look-up table 1218 to the saturation ramp 1224, which 
determines the saturation qualifier (o^) for the pixel. And 
the luminance qualification curve for the pixel is passed 
from the luminance look-up table 1220 to the luminance 
ramp 1226, which determines the luminance qualifier 
(oty) for the pixel. 

[0125] The hue qualifier (oc^, the saturation qualifier 
(Og), and the luminance qualifier (cty) are multiplied to 
produce a total alpha qualifier (04), which is optionally 
passed to an alpha filter 1228. The alpha filter includes 
an additional qualification curve that may be defined 
with respect hue, saturation, or luminance. Accordingly, 
any or all of the hue-domain parameters (H.S.Y) for the 
given pixel may be passed to the alpha filter 1228. The 
alpha filter determines an alpha-filter qualifier for the 
given pixel that is multiplied by the total alpha qualifier 
(at) to produce the final alpha qualifier (a). The final 
alpha qualifier (a) is then passed to an alpha mixer 
1230. 

[0126] The user control interface 1214 also controls 
the- configuration of a color correction look-up table 
1 232 that includes the coefficients of the T-matrix for the 
various color correction channels. The index number is 
passed from the index generator 1212 to the color cor- 
rection look-up table 1232, which passes the color cor- 
rection coefficients for the pixel's color correction 
channel to a T-matrix multiplier array 1234. The T-matrix 
multiplier array 1234 also receives the input data signal 
1208, which includes the input color value (R in ,G in ,Bi n ) 
for the given pixel. The T-matrix multiplier array 1234 
uses the input color value and the color correction coef- 
ficients to compute the unqualified corrected color value 
(R',G',B') for the pixel. The T-matrix multiplier array 1 234 
then passes the unqualified corrected color value to the 
alpha mixer 1230. The mathematics and programmable 
logic unit circuitry of the T-matrix multiplier array 1234 is 
shown in FIG. 13B. 

[01 27] The alpha mixer 1 230 receives the input color 
value (R in ,G in ,Bi n ), the unqualified corrected color value 
(R'.G'.B*), and the final alpha qualifier (a) for the given 
pixel. The alpha mixer 1230 then computes the output 
color value (R 0 ut.Gout. B out) as a weighted sum of the 
input color value (R in ,Gj n ,B in ) and the unqualified cor- 
rected color value (R'.G'.B'), where final alpha qualifier 
(a) defines the weighting parameters, as shown in the 



following alpha-mixing formula: 

R out = aR* + (1-a)R |n 

5 G 0Ut = aG' + (1-a)G ln 

B out = aB' + (1-a)B in 

[01 28] FIG. 1 3 A is a schematic block diagram illustrat- 
10 ing a color mixer circuit 1300 that may be implemented 
within the alpha mixer 1230. The color mixer circuit 
1300 implements the alpha mixing formula shown 
above with two multipliers and one adder. In terms of 
programmable logic units, multipliers are more expen- 
ds sive than adders or subtracters. Therefore, it is advanta- 
geous to replace multipliers with adders or subtracters 
when possible. As shown in FIG. 13A, the alpha-mixing 
formula may be rearranged into a revised alpha-mixing 
formula that obtains the same result with one multiplica- 
20 tion step and two subtraction steps. The alternative 
color mixer circuit 1 302 shows the circuit for implement- 
ing the revised alpha-mixing formula using programma- 
ble logic units. 

[01 29] FIG. 1 3B is a schematic block diagram illustrat- 
es ing the structure of a representative T-matrix multiplica- 
tion circuit 1306. The T-matrix multiplication circuit 1306 
implements the T-matrix multiplication formula 1304 
shown in FIG. 13B using programmable logic units. 
[0130] FIG. 14 is a schematic block diagram illustrat- 
30 ing an index generator circuit 1212 implemented with 
programmable logic units. Each color correction chan- 
nel (i.e., hue sector) is defined by two comparison 
blocks. A first comparison block determines whether the 
hue parameter H for a given pixel is greater than the 
35 lower boundary of a corresponding color correction 
channel. And a second comparison block determines 
whether the hue parameter H for the pixel is less than or 
equal to the upper boundary of the color correction 
channel. If both conditions are satisfied, the pixel falls 
40 within the corresponding color correction channel, and 
an encoder returns the index number for the corre- 
sponding color correction channel. 
[0131] Thus, the present invention implements pri- 
mary color manipulation using secondary color correc- 
ts tion region isolation. As such, the system performs color 
correction in the primary color domain, which means 
that color data that is not manipulated passes through 
the system unaltered. In view of the foregoing descrip- 
tion of the preferred embodiments of the invention, other 
50 embodiments will suggest themselves to those skilled in 
the art. Therefore, the scope of the present invention is 
to be limited only by the claims set forth below. 

Claims 

55 

1. A computer-implemented process for selectively 
applying image processing to an image, the proc- 
ess carried out in a computer system coupled to an 
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image source, comprising the steps of: 

receiving an input signal from the image source 
in a primary color domain; 
receiving a command selecting a sample of the 
input signal; 

receiving a command identifying a color correc- 
tion parameter in the primary color domain 
associated with the sample; 
determining a hue-domain parameter associ- 
ated with the sample; 

defining a sector in the hue-domain about the 
hue-domain parameter associated with the 
sample; 

defining a qualification curve corresponding to 
the sector; and 

mixing the input signal and the color correction 
parameter within the sector in accordance with 
the qualification curve. 

2. The method of Claim 1 , wherein: 



ing to the sector; 

combining the first, second, and third qualifica- 
tion curves to obtain a total qualification curve; 
and wherein 

s the step of mixing the input signal comprises 

the step of mixing the input signal the color cor- 
rection parameter within the sector in accord- 
ance with the total qualification curve. 

10 6. The method of Claim 1 wherein: 

the first, second, and third hue-domain param- 
eters include the including hue, saturation, and 
luminance. 
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the hue-domain parameter is selected from the 
group including hue, saturation, and lumi- 
nance. 25 



The method of Claim 5, 
steps of: 



further comprising the 



applying a filter to the total qualification curve to 
obtain an alpha qualification curve; and 
wherein 

the step of mixing the input signal comprises 
the step of mixing the input signal and the color 
correction parameter within the sector in 
accordance with the alpha qualification curve. 



The method of Claim 1, wherein the hue-domain 
parameter is a first hue-domain parameter and the 
qualification curve is a first qualification curve, fur- 
ther comprising the steps of: 30 



determining a second hue-domain parameter 
associated with the sample; 
defining a second qualification curve about the 
second hue-domain parameter and corre- 
sponding to the sector; 

combining the first and second qualification 
curves to obtain a combined qualification 
curve; and wherein 

the step of mixing the input signal comprises 
the step of mixing the input signal and the color 
correction parameter within the sector in 
accordance with the combined qualification 
curve. 



4. The method of Claim 3, wherein: 



determining a third hue-domain parameter 
associated with the sample; 
defining a third qualification curve about the 
third hue-domain parameter and correspond- 
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the first and second hue-domain parameters 
are selected from the group including hue, sat- 
uration, and luminance. so 

The method of Claim 3, further comprising the 
steps of: 



55 



The method of Claim 5, further comprising the 
steps of: 

defining a geometric constraint corresponding 
to the input signal; and 

limiting the mixing the input signal and the color 
correction parameter in accordance with the 
geometric constraint. 

A computer-implemented process for selectively 
applying image processing to a plurality of. frames 
defining a scene, the process carried out in a com- 
puter system coupled to an image source, compris- 
ing the steps of: 

receiving an input signal defining the scene 
from the image source in a primary color 
domain; 

receiving a command selecting a target frame 
of the scene; 

receiving a command selecting a sample of the 
target frame; 

receiving a command identifying a color correc- 
tion parameter in the primary color domain 
associated with the sample; 
determining a hue-domain parameter associ- 
ated with the sample; 

defining a sector in the hue-domain about the 
hue-domain parameter associated with the 
sample; 

defining a qualification curve corresponding to 
the sector; and 
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for each frame of the scene, mixing the input 
signal and the color correction parameter 
within the sector in accordance with the qualifi- 
cation curve. 

10. The method of Claim 9, wherein: 

the hue-domain parameter is selected from the 
group including hue, saturation, and lumi- 
nance. 



15. The method of Claim 13, further comprising the 
steps of: 

applying a filter to the total qualification curve to 
5 obtain an alpha qualification curve; and 

wherein 

the step of mixing the input signal comprises 
the step of mixing the input signal and the color 
correction parameter within the sector in 
w accordance with the alpha qualification curve. 



11. The method of Claim 10, wherein the hue-domain 
parameter is a first hue-domain parameter and the 
qualification curve is a first qualification curve, fur- 
ther comprising the steps of: 

determining a second hue-domain parameter 
associated with the sample; 
defining a second qualification curve about the 
second hue-domain parameter and corre- 
sponding to the sector; 

combining the first and second qualification 
curves to obtain a combined qualification 
curve; and wherein 

the step of mixing the input signal comprises 
the step of mixing the input signal and the color 
correction parameter within the sector in 
accordance with the combined qualification 
curve. 

12. The method of Claim 1 1 , wherein: 
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16. The method of Claim 13, further comprising the 
steps of: 

defining a geometric constraint corresponding 
to the input signal; and 

limiting the mixing the input signal and the color 
correction parameter in accordance with the 
geometric constraint. 



the first and second hue-domain parameters 
are selected from the group including hue, sat- 
uration, and luminance. 35 

13. The method of Claim 1, further comprising the 
steps of: 



determining a third hue-domain parameter <o 
associated with the sample; 
defining a third qualification curve about the 
third hue-domain parameter and correspond- 
ing to the sector; 

combining the first, second, and third qualif ica- 45 
tion curves to obtain a total qualification curve; 
and wherein 

the step of mixing the input signal comprises 
the step of mixing the input signal the color cor- 
rection parameter within the sector in accord- so 
ance with the total qualification curve. 



14. The method of Claim 10 wherein: 



the first, second, and third hue-domain param- ss 
eters include the including hue, saturation, and 
luminance. 
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